Open-source projects tagged “caching”

A KV cache management layer that stores, shares and reuses LLM attention caches across serving engines to cut time-to-first-token.

An in-memory data store used as a cache, data structure server, document store, vector database, and message broker.

A programmable automation engine that builds, tests and ships codebases using containers, running locally, in CI or in the cloud.