A C++ tool that splits LLM inference across multiple home devices over Ethernet to speed up generation.
3.1K258C++MITUpdated 11 days ago
#llama3
Curated GitHub repositories related to llama3, with AI summaries and key stats.
A C++ tool that splits LLM inference across multiple home devices over Ethernet to speed up generation.