Dao-AILab Blog https://dao-lab.ai/blog/ Research blog from Dao-AILab http://www.rssboard.org/rss-specification python-feedgen en Sun, 05 Apr 2026 03:18:02 +0000 Gram Newton-Schulz: A Fast, Hardware-Aware Newton-Schulz Algorithm for Muon https://dao-lab.ai/blog/2026/03/30/gram-newton-schulz/ Gram Newton-Schulz: A Fast, Hardware-Aware Newton-Schulz Algorithm for Muon https://dao-lab.ai/blog/2026/03/30/gram-newton-schulz/ Mon, 30 Mar 2026 00:00:00 +0000 Mamba-3 Part 2 - Methodological Deep Dive https://dao-lab.ai/blog/2026/03/16/mamba3-part2/ Mamba-3 Part 2 - Methodological Deep Dive https://dao-lab.ai/blog/2026/03/16/mamba3-part2/ Mon, 16 Mar 2026 00:00:00 +0000 Mamba-3 Part 1 https://dao-lab.ai/blog/2026/03/16/mamba3-part1/ Mamba-3 Part 1 https://dao-lab.ai/blog/2026/03/16/mamba3-part1/ Mon, 16 Mar 2026 00:00:00 +0000 FlashAttention-4: Algorithm and Kernel Pipelining Co-Design for Asymmetric Hardware Scaling https://dao-lab.ai/blog/2026/03/05/flash4/ FlashAttention-4: Algorithm and Kernel Pipelining Co-Design for Asymmetric Hardware Scaling https://dao-lab.ai/blog/2026/03/05/flash4/ Thu, 05 Mar 2026 00:00:00 +0000 FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precision https://dao-lab.ai/blog/2024/07/11/flash3/ FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precision https://dao-lab.ai/blog/2024/07/11/flash3/ Thu, 11 Jul 2024 00:00:00 +0000 State Space Duality (Mamba-2) Part IV - The Systems https://dao-lab.ai/blog/2024/05/31/mamba2-part4-systems/ State Space Duality (Mamba-2) Part IV - The Systems https://dao-lab.ai/blog/2024/05/31/mamba2-part4-systems/ Fri, 31 May 2024 00:00:00 +0000 State Space Duality (Mamba-2) Part III - The Algorithm https://dao-lab.ai/blog/2024/05/31/mamba2-part3-algorithm/ State Space Duality (Mamba-2) Part III - The Algorithm https://dao-lab.ai/blog/2024/05/31/mamba2-part3-algorithm/ Fri, 31 May 2024 00:00:00 +0000 State Space Duality (Mamba-2) Part II - The Theory https://dao-lab.ai/blog/2024/05/31/mamba2-part2-theory/ State Space Duality (Mamba-2) Part II - The Theory https://dao-lab.ai/blog/2024/05/31/mamba2-part2-theory/ Fri, 31 May 2024 00:00:00 +0000 State Space Duality (Mamba-2) Part I - The Model https://dao-lab.ai/blog/2024/05/31/mamba2-part1-model/ State Space Duality (Mamba-2) Part I - The Model https://dao-lab.ai/blog/2024/05/31/mamba2-part1-model/ Fri, 31 May 2024 00:00:00 +0000