Open-source projects tagged “amd”

A KV cache management layer that stores, shares and reuses LLM attention caches across serving engines to cut time-to-first-token.

A fast, memory-efficient library and server for running and serving large language models with an OpenAI-compatible API.