A fast, flexible library for structured LLM generation that constrains model output to JSON, regex, or custom context-free grammars.
AI & Machine Learning#large-language-models#structured-generation#constrained-decoding#json#llm-inference
2K241PythonApache-2.0Updated 3 days ago