DL-14
Speculative Decoding Experiment
Implement or integrate draft/target decoding, measure acceptance and speedup, and document when overhead loses.
DL-14
Implement or integrate draft/target decoding, measure acceptance and speedup, and document when overhead loses.