Orion: Characterizing and Programming Apple's Neural Engine for LLM Training and Inference

Orion: Characterizing and Programming Apple's Neural Engine for LLM Training and Inference explores Orion unlocks the Apple Neural Engine for LLM training and inference, offering a direct programming interface and significant speedups.. Commercial viability score: 7/10 in LLM Training.