A Python library from Microsoft that compresses LLM prompts and KV cache by up to 20x by dropping non-essential tokens, with minimal loss in performance.
6.8K444PythonMITUpdated last month
#prompt-compression
Open-source projects tagged “prompt-compression”
Curated GitHub repositories related to prompt-compression, with AI summaries and key stats.
Sort:Recently added
2 repositories
A Rust binary that deterministically compresses coding-agent prompts and tool output, with removed content retrievable on demand.
216RustMITUpdated 20 hours ago