AMD Ryzen AI NPUs Are Finally Useful Under Linux for Running LLMs
0 net
AMD Ryzen AI NPUs Are Finally Useful Under Linux For Running LLMs - Phoronix Articles & Reviews News Archive Forums Premium Ad-Free Contact Popular Categories Close Articles & Reviews News Archive Forums Premium Contact Categories Computers Display Drivers Graphics Cards Linux Gaming Memory Motherboards Processors Software Storage Operating Systems Peripherals AMD Ryzen AI NPUs Are Finally Useful Under Linux For Running LLMs Written by Michael Larabel in AMD on 11 March 2026 at 12:21 PM EDT. 36 Comments Over the past two years AMD has developed the AMDXDNA accelerator driver in the mainline Linux kernel for supporting the AMD Ryzen AI NPUs. But when it comes to user-space software on Linux actually able to leave the Ryzen AI NPUs it's been... extremely limited with nothing really useful besides some niche bits of code. Even AMD's own software like their GAIA on Linux has used Vulkan with their iGPUs rather than any NPU support . But finally today there is a significant shift with the Ryzen AI NPUs becoming useful on Linux and able to handle LLMs. The open-source Lemonade server for running LLMs today saw the release of Lemonade 10.0 and with it comes LInux NPU support for large language models as well as Whisper. Plus there is also native integration with Claude Code in Lemonade 10.0. Lemonade for its Linux Ryzen AI NPU support is building off FastFlowLM as a means to "unlock Ryzen AI NPUs" as an NPU-first runtime built exclusively for Ryzen AI. FlastFlowLM with current-gen Ryzen AI NPUs can support context lengths up to 256k tokens. FastFlowLM 0.9.35 released this morning and it comes with official native Linux support. Besides the Lemonade 10.0 server and latest FastFlowLM runtime, you also need to be using the Linux 7.0 kernel or the AMDXDNA driver back-ports coming to existing stable kernel versions due to some last minute accelerator driver tweaks. This Ryzen AI NPU support on Linux should work with all current AMD Ryzen AI 300/400 series SoCs. There is this Lemonade documentation guide that outlines running LLMs on Linux with FastFlowLM and Lemonade. I'll be giving this AMD Ryzen AI NPU support on Linux a try in the days ahead with the hardware I have available. (Sadly the HP ZBook Ultra G1a review sample needed to be returned long ago for the Ryzen AI Max+ 395 in laptop form, but there is always the Framework Desktop and then the Ryzen AI 300 Strix Point hardware I have in the lab.) Hopefully all goes well with this long-awaited Ryzen AI NPU Linux LLM support for some benchmarking. The timing of this is important with the Ryzen AI Embedded P100 series coming to market as well as the Ryzen AI PRO 400 series that given their markets will surely be seeing more Linux use than the typical consumer Windows deployments. Now there is finally a story to tell there around the Ryzen AI NPU LLM support on Linux. 36 Comments Tweet AMD ZenDNN 5.2 Brings A Major Redesign, AOCC 5.1 Recently Released AMD Formally Launches Ryzen AI Embedded P100 Series 8-12 Core Models AMD GAIA 0.16 Introduces C++17 Agent Framework For Building AI PC Agents In Pure C++ AMD CPPC Performance Priority Being Prepared For Linux - New Zen 6 Feature AMD HSMP Linux Driver Preps For Zen 6 EPYC With Finer Power Controls Linux Preps IBPB-On-Entry Feature For AMD SEV-SNP Guest VMs Michael Larabel is the principal author of Phoronix.com and founded the site in 2004 with a focus on enriching the Linux hardware experience. Michael has written more than 20,000 articles covering the state of Linux hardware support, Linux performance, graphics drivers, and other topics. Michael is also the lead developer of the Phoronix Test Suite, Phoromatic, and OpenBenchmarking.org automated benchmarking software. He can be followed via Twitter , LinkedIn , or contacted via MichaelLarabel.com . Ubuntu 26.04 LTS Officially Supporting Cloud-Based Authentication With Authd CachyOS Handheld Edition Switches To Wayland, CachyOS Installer Drops Bcachefs LLM-Driven Large Code Rewrites With Relicensing Are The Latest AI Concern Linux 7.0-rc3 Released: "Some Of The Biggest In Recent History" System76 Comments On Recent Age Verification Laws Linux Mint Ready With Its Wayland-Compatible Cinnamon Screensaver KDE Plasma Saw A Lot Of Bug/Crash Fixing & UI Polishing This Week Rust Coreutils 0.7 Released With Many Performance Optimizations Vulkan 1.4.346 Released With Notable VK_KHR_device_address_commands FreeRDP 3.24 Released With Security Fixes & Improved X11 Client Support Linux 7.0 AMDGPU Fixing Idle Power Issue For RDNA4 GPUs After Compute Workloads Intel NPU Driver 1.30 Released For Linux TrueNAS Connect Announced For Offering Enterprise Features Without The Hardware Ubuntu's AppArmor Hit By Several Security Issues - Can Yield Local Privilege Escalation Linux 7.0 cpupower Now Handles systemd Service Setting EPP, Intel P-State Turbo Boost Google To Finally Provide Chrome ARM64 Binaries For Linux systemd 260-rc3 Released With AI Agents Documentation Added AMD HDR/Color Improvement For Their Linux Driver & KDE - Co-Developed By Claude Code Fwupd 2.1.1 Released With Lots Of New Hardware Support Phoronix Premium allows ad-free access to the site, multi-page articles on a single page, and other features while supporting this site's continued operations. Intel CPU Security Mitigation Costs From Haswell Through Panther Lake Exclusive Preview Of System76's Completely Redesigned Thelio Desktop Ubuntu 26.04 With GNOME 50 Offering Some Performance Benefits For NVIDIA Linux Gaming MSI PRO B850-P WiFi: A Special AMD Ryzen AM5 Motherboard For Linux / Open-Source Enthusiasts NVIDIA 595 Linux Driver Running Well In Early Benchmarks The mission at Phoronix since 2004 has centered around enriching the Linux hardware experience. In addition to supporting our site through advertisements, you can help by subscribing to Phoronix Premium . You can also contribute to Phoronix through tips/donations via PayPal or Stripe . Contact Michael Larabel Support Phoronix While Having Ad-Free Browsing, Single-Page Article Viewing Facebook Twitter / X Legal Disclaimer, Privacy Policy, Cookies | Privacy Manager | Contact Copyright © 2004 - 2026 by Phoronix Media . All trademarks used are properties of their respective owners. All rights reserved.