Open-source projects tagged “attention”

Official implementation of FlashAttention, a memory-efficient exact attention kernel for training and inference of Transformer models on GPUs.

SGLang is an open-source inference framework for serving large language, vision-language, and diffusion models on many GPU, TPU, and CPU platforms.