apple-silicon

21 posts tagged “apple-silicon”.

1. We Published a 36% Speedup and Withdrew It the Next Day (2026-09-19)
2. Our Two Machines Ran Different Models Under the Same Name (2026-09-18)
3. Speculative Decoding Won Alone and Lost Batched (2026-09-18)
4. Your Headline tok/s Is a Short-Prompt Number (2026-09-18)
5. Run Local AI on a Mac: A Realistic Guide (What Works, What Doesn't) (2026-09-17)
6. We indexed 45 local-inference benchmark results — the 4.7x gap nobody looks for (2026-09-14)
7. Every GPU Out-of-Memory Error Was One sysctl (2026-09-12)
8. 17 GB of Attention Buffers Nobody Read (2026-09-12)
9. Can SSD Offload Fit a Model Twice Your RAM? The Arithmetic. (2026-09-12)
10. Five Kernel Ideas That Measured Neutral or Worse (2026-09-12)
11. We Put the Neural Engine to Work on Prefill. It Added 19%. (2026-09-11)
12. We Wrote Our Own Inference Engine. It Started at 0.9 tok/s. (2026-09-06)
13. We Panicked the Same Machine Twice in One Day (2026-09-06)
14. Our Kernel Benchmark Was Measuring the System Cache (2026-09-05)
15. We Evaluated a Faster Inference Engine and Rejected It (2026-09-03)
16. 2x Decode From Block-Diffusion Drafting (2026-09-03)
17. Benchmark the Hardware Before You Benchmark the Software (2026-09-02)
18. Unfusing a Kernel Made It 1.63x Faster (2026-09-01)
19. A 192 GB Model on a 256 GB Box (2026-08-27)
20. One Environment Variable Cost Us 60x on Cache Hits (2026-08-24)
21. One Abandoned Request Wedged the Whole Server (2026-08-23)