A high-performance, easy-to-use engine for LLM inference and serving, with an OpenAI-compatible API server.
55246C++OtherUpdated 2 months ago
#ascend-npu
Curated GitHub repositories related to ascend-npu, with AI summaries and key stats.
A high-performance, easy-to-use engine for LLM inference and serving, with an OpenAI-compatible API server.