Speculative Decoding: Scout & Surveyor

One draft round, traced token by token: a small model guesses ahead, a big model checks the whole guess in one sweep, and decides — token by token — what to keep, what to throw out, and what to mint fresh.

SCOUT = draft model, q(x) SURVEYOR = target model, p(x) RULE = accept w.p. min(1, p/q) τ = accepted length