Repolode
Submit
KalyanKS-NLP

KalyanKS-NLP/llm-engineer-toolkit

A curated, category-wise list of 120+ open-source libraries for building, training, serving, evaluating and monitoring LLM applications.

View on GitHubWebsite
Stars
10,886
Forks
1,709
Open issues
23
Last commit
10 days ago

What is it?

LLM Engineer Toolkit is a curated directory of more than 120 open-source libraries used in large language model work. Entries are grouped into categories such as training and fine-tuning, application development, RAG, inference, serving, data extraction, data generation, agents, evaluation, monitoring, prompts, structured outputs, safety and embedding models.

Each category lists project names with a short description and a link to the project, so a developer can quickly find candidate tools for a specific stage of an LLM pipeline. The list also includes a few related reading and interview-preparation resources from the author.

The repository itself is a Markdown document rather than a software package, so it has no code to install or run.

Key features

  • 01Groups 120+ LLM libraries into about 15 categories.
  • 02Each entry gives a one-line description and a link to the project.
  • 03Covers the full pipeline from fine-tuning and RAG to serving, agents and evaluation.
  • 04Includes monitoring, safety and structured-output tools alongside core frameworks.

Use cases

  • Choosing a fine-tuning or inference library for a new LLM project.
  • Finding a vector, RAG or agent framework to compare before committing to one.
  • Building a shortlist of evaluation or observability tools for production LLM apps.

Topics

#llm#awesome-list#generative-ai#rag#ai-agents#fine-tuning#llm-evaluation#ai-engineer#large-language-models#llm-engineer

FAQ

What is llm-engineer-toolkit?
A curated, category-wise list of 120+ open-source libraries for building, training, serving, evaluating and monitoring LLM applications. LLM Engineer Toolkit is a curated directory of more than 120 open-source libraries used in large language model work. Entries are grouped into categories such as training and fine-tuning, application development, RAG, inference, serving, data extraction, data generation, agents, evaluation, monitoring, prompts, structured outputs, safety and embedding models.
Is llm-engineer-toolkit free to use? What license does it have?
llm-engineer-toolkit is open source under the Apache-2.0 license. Check the license terms before using it in commercial products.
Is llm-engineer-toolkit still maintained?
Actively maintained. The last commit to llm-engineer-toolkit was on Oct 11, 2026.
What can I use llm-engineer-toolkit for?
Choosing a fine-tuning or inference library for a new LLM project. Finding a vector, RAG or agent framework to compare before committing to one. Building a shortlist of evaluation or observability tools for production LLM apps.
Where can I get llm-engineer-toolkit?
The source code and installation instructions are on GitHub: https://github.com/KalyanKS-NLP/llm-engineer-toolkit

Summary generated by AI from the project's README. GitHub stats refresh daily.

Related projects