A C++ tool that splits LLM inference across multiple home devices over Ethernet to speed up generation.
3.1K258C++MITUpdated 11 days ago
#llama2
Curated GitHub repositories related to llama2, with AI summaries and key stats.
A C++ tool that splits LLM inference across multiple home devices over Ethernet to speed up generation.