speculative-decoding

4 posts tagged “speculative-decoding”.

1. Speculative Decoding Won Alone and Lost Batched (2026-09-18)
2. Five Kernel Ideas That Measured Neutral or Worse (2026-09-12)
3. 2x Decode From Block-Diffusion Drafting (2026-09-03)
4. JSON Mode Was Causing the Malformed JSON (2026-08-07)