CPU ISA for ML
A guide to CPU instruction-set features for ML workloads - the VNNI layout and Intel AMX/TPP performance on Granite Rapids
- VNNI Data Layout for Intel AMX Matrix Multiplication
A technical tutorial on Intel AMX matrix multiplication, the VNNI layout requirement, its silent correctness failure mode, and LIBXSMM dispatch.