Open-source Python framework for building real-time voice and multimodal AI agents, with pluggable speech, LLM, and transport services.
livekit/agents
A Python framework for building realtime voice and video AI agents that run as server-side participants in LiveKit rooms.
- Stars
- 14,887
- Forks
- 3,979
- Open issues
- 802
- Last commit
- 8 hours ago
What is it?
Agents is a Python framework for building realtime, programmable participants that run on servers. It lets developers create conversational, multi-modal voice agents that can hear, see, and respond within LiveKit rooms, connecting end users to agents through dispatch APIs.
The framework lets you combine speech-to-text, LLM, text-to-speech, and realtime model providers in one pipeline. It includes semantic turn detection based on a transformer model to reduce interruptions, native MCP support for adding tools from MCP servers, and data exchange with clients through RPCs and data APIs. Telephony integration allows an agent to place or receive phone calls.
Agents can be run in a local terminal for testing, in a dev mode with hot reloading, or in production mode. The project also ships a built-in test framework where judges can check agent behavior. It is Apache-2.0 licensed, and the stack can be self-hosted together with the LiveKit server.
Key features
- 01Mix and match STT, LLM, TTS, and realtime API providers in one pipeline.
- 02Semantic turn detection using a transformer model to reduce interruptions.
- 03Native MCP support to load tools from MCP servers.
- 04Telephony integration for making and receiving phone calls.
- 05Data exchange with clients via RPCs and data APIs.
- 06Built-in test framework with judges for checking agent behavior.
Use cases
- Building a customer support voice agent that answers calls over the phone.
- Creating an outbound calling agent that places automated calls.
- Adding a multi-user transcriber to produce transcripts for everyone in a room.
- Developing a vision-enabled assistant that reacts to live video from users.
Quick start
- 1
Install the core library with model provider plugins
pip install "livekit-agents[openai,deepgram,cartesia]" - 2
Set LIVEKIT_URL, LIVEKIT_API_KEY and LIVEKIT_API_SECRET environment variables
- 3
Save the example agent as myagent.py and test it in terminal mode
python myagent.py console
Things to know
- The quick start example relies on LiveKit Inference or external model provider API keys, which are typically paid services.
- Connecting to a live room requires a LiveKit Cloud account or a self-hosted LiveKit server.
Topics
FAQ
- What is agents?
- A Python framework for building realtime voice and video AI agents that run as server-side participants in LiveKit rooms. Agents is a Python framework for building realtime, programmable participants that run on servers. It lets developers create conversational, multi-modal voice agents that can hear, see, and respond within LiveKit rooms, connecting end users to agents through dispatch APIs.
- Is agents free to use? What license does it have?
- agents is open source under the Apache-2.0 license. Check the license terms before using it in commercial products.
- Is agents still maintained?
- Actively maintained. The last commit to agents was on Oct 22, 2026.
- What can I use agents for?
- Building a customer support voice agent that answers calls over the phone. Creating an outbound calling agent that places automated calls. Adding a multi-user transcriber to produce transcripts for everyone in a room. Developing a vision-enabled assistant that reacts to live video from users.
- How do I install agents?
- Install the core library with model provider plugins: pip install "livekit-agents[openai,deepgram,cartesia]" Set LIVEKIT_URL, LIVEKIT_API_KEY and LIVEKIT_API_SECRET environment variables Save the example agent as myagent.py and test it in terminal mode: python myagent.py console
- Where can I get agents?
- The source code and installation instructions are on GitHub: https://github.com/livekit/agents
Summary generated by AI from the project's README. GitHub stats refresh daily.
Related projects
Open-source framework for real-time multimodal conversational voice AI agents, with prebuilt agent examples and a visual designer.
Local-first open-source AI voice studio for cloning voices, generating speech, dictating into any app, and giving AI agents a voice.
Open-source Python and TypeScript SDK that gives an AI voice agent a phone number, handling LLM, speech, and carrier layers.
Real-time two-way speech translation for bilingual meetings, with cloud providers or fully offline on-device models, as a desktop app and browser extension.
Self-hostable open-source voice AI platform for building, testing and deploying phone and browser voice agents, with a visual workflow builder and MCP support.