A C++ tool that splits LLM inference across multiple home devices over Ethernet to speed up generation.
3.1K258C++MITUpdated 11 days ago
#distributed-llm
Open-source projects tagged “distributed-llm”
Curated GitHub repositories related to distributed-llm, with AI summaries and key stats.