TileFuse: A Fused Mixed-Precision Kernel Library for Efficient Quantized LLM Inference on AMD NPUs
arXiv:2606.11357v2 Announce Type: replace-cross Abstract: With the growing demand for on-device LLM inference, edge SoCs increasingly integrate NPUs to improve performance and energy efficiency under tight power and thermal budgets. However, practical LLM deployment on current client NPUs remains difficult: widely used
The thing to notice is TileFuse; decide whether it changes your next build. For researchers and builders, this is an early signal to fold into evaluation, model choice, or agent design.