DeepSeek has launched FlashMLA, a groundbreaking Multi-head Latent Attention (MLA) decoding kernel optimized for NVIDIA’s Hopper GPU architecture, marking the first major release of its Open Source Week initiative. This innovative tool achieves unprecedented performance metrics of 3000 GB/s memory bandwidth and 580 TFLOPS computational throughput on H800 GPUs, setting new benchmarks for AI inference […]
The post DeepSeek Unveils FlashMLA, A Decoding Kernel That’s Make Things Blazingly Fast appeared first on Cyber Security News.
This article has been indexed from Cyber Security News