Repolode
投稿する
mudler

mudler/LocalAI

A self-hosted, OpenAI-compatible AI engine that runs LLMs, vision, voice, image and video models on any hardware, including CPU-only machines.

代替できる製品:OpenAI API

GitHub で見る公式サイト
スター
49,633
フォーク
4,507
未解決の Issue
202
最終コミット
2 時間前

これは何？

LocalAI is an open-source engine for serving AI models on your own infrastructure. It exposes OpenAI, Anthropic and ElevenLabs compatible APIs, so existing client code can point at a local server instead of a hosted service. It covers text generation, vision, speech-to-text and text-to-speech, image and video generation, embeddings, reranking and object detection behind one API.

The core stays small. Each backend wraps an engine such as llama.cpp, vLLM, whisper.cpp, stable-diffusion or MLX and is installed as its own image only when a model needs it. Hardware support includes NVIDIA CUDA, AMD ROCm, Intel oneAPI, Apple Silicon Metal, Vulkan and CPU-only operation.

Beyond inference, LocalAI includes API key authentication, per-user quotas, built-in agents with tool use and RAG, MCP support, and a distributed mode that uses PostgreSQL and NATS for horizontal scaling.

主な機能

  • 01OpenAI, Anthropic and ElevenLabs compatible API endpoints across backends
  • 02Runs LLMs, vision, speech, image and video models behind one API
  • 03Backends install on demand, so only the engines a model needs are pulled
  • 04Supports NVIDIA, AMD, Intel, Apple Silicon, Vulkan and CPU-only hardware
  • 05Built-in agents with tool use, RAG and MCP support
  • 06API key auth, per-user quotas and role-based access for multi-user setups

ユースケース

  • Running a private, self-hosted replacement for hosted OpenAI-style APIs
  • Serving open models on a workstation or server without a dedicated GPU
  • Building voice assistants that combine speech-to-text, an LLM and text-to-speech locally
  • Operating a shared model service for a team with per-user quotas and API keys

トピック

#llm#openai-compatible#self-hosted#inference#multimodal#rag#text-to-speech#image-generation#agents#ai

よくある質問

LocalAI とは？
A self-hosted, OpenAI-compatible AI engine that runs LLMs, vision, voice, image and video models on any hardware, including CPU-only machines. LocalAI is an open-source engine for serving AI models on your own infrastructure. It exposes OpenAI, Anthropic and ElevenLabs compatible APIs, so existing client code can point at a local server instead of a hosted service. It covers text generation, vision, speech-to-text and text-to-speech, image and video generation, embeddings, reranking and object detection behind one API.
LocalAI は無料で使えますか？ライセンスは？
LocalAI は MIT ライセンスのオープンソースです。商用製品で使う前にライセンス条件を確認してください。
LocalAI は今もメンテナンスされていますか？
活発にメンテナンス中。LocalAI の最終コミットは 2026年10月19日 です。
LocalAI は何に使えますか？
Running a private, self-hosted replacement for hosted OpenAI-style APIs Serving open models on a workstation or server without a dedicated GPU Building voice assistants that combine speech-to-text, an LLM and text-to-speech locally Operating a shared model service for a team with per-user quotas and API keys
LocalAI はどこで入手できますか？
ソースコードとインストール手順は GitHub にあります：https://github.com/mudler/LocalAI

概要はプロジェクトの README をもとに AI が生成しています。GitHub の数値は毎日更新されます。

関連プロジェクト