Implementation of FlashAttention-2 for Nvidia Tesla V100
-
Updated
Mar 22, 2026 - Cuda
#
cuda-core
Here are 5 public repositories matching this topic...
Decoding Attention is specially optimized for MHA, MQA, GQA and MLA using CUDA core for the decoding stage of LLM inference.
gpu cuda inference nvidia mha mla multi-head-attention gqa mqa llm large-language-model flash-attention cuda-core decoding-attention flashinfer flashmla
-
Updated
Jun 11, 2025 - C++
⚡ Optimize attention mechanisms with FlashMLA, a library of advanced sparse and dense kernels for DeepSeek models, improving performance and efficiency.
windows gpu cuda inference nvidia mha mla multi-head-attention gqa mqa llm flash-attention cuda-core decoding-attention deepseek flashinfer flashmla
-
Updated
Mar 29, 2026 - C++
🚀 Accelerate attention mechanisms with FlashMLA, featuring optimized kernels for DeepSeek models, enhancing performance through sparse and dense attention.
windows gpu cuda inference nvidia nvidia-cuda mla multi-head-attention mqa llm flash-attention cuda-core decoding-attention deepseek flashinfer flashmla
-
Updated
Mar 29, 2026 - C++
Improve this page
Add a description, image, and links to the cuda-core topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the cuda-core topic, visit your repo's landing page and select "manage topics."