Back to explore

Kev-0.6B Jev-class decision model runs one forward pass on Apple Neural Engine

Kev-0.6B is a Jev-class decision model running on the Apple Neural Engine. One forward pass, no token generation, 7.18 ms per decision with p99 of 7.53 ms. Placement isn't asserted yet; it's measured three ways: CPU-only returns zeros, and Apple's xctrace Neural Engine instrument counts 303.

Kev-0.6B, a Jev-class decision model, running on the Apple Neural Engine. One forward pass, no token generation. 7.18 ms per decision, p99 7.53. Placement isn't asserted yet, it's measured three ways: CPU-only returns zeros, Apple's xctrace Neural Engine instrument counts 303

· 1 likesOpen on X