Serving DeepSeek-V4.1-Flash (552B MoE) across four NVIDIA DGX Sparks with TensorFold and vLLM, with launch scripts, patches and measured results.
1190PythonMITUpdated 13 hours ago
#vllm
Curated GitHub repositories related to vllm, with AI summaries and key stats.
Serving DeepSeek-V4.1-Flash (552B MoE) across four NVIDIA DGX Sparks with TensorFold and vLLM, with launch scripts, patches and measured results.
Python library that detects LLM decoding corruption such as repetition loops and language drift mid-stream, so bad tokens can be cut before users see them.
A 9B-parameter open-weight multimodal model for visual understanding, spatial reasoning, agentic tool use, and embodied-AI research, built on Qwen3.5 and C-RADIOv4-H.
Open-weight 4B and 1.7B general-purpose language models from XHToken, aimed at on-device use and agentic tool-calling workflows.