Open-source projects tagged “evaluation-framework”

A unified framework for running few-shot evaluations of language models across dozens of standard academic benchmarks.

Open-source Python framework for unit-testing LLM apps, with metrics for RAG, agents, chatbots, voice agents and more, similar in spirit to Pytest.

A CLI and library for evaluating prompts and red-teaming LLM apps, with declarative configs and CI/CD integration.