Qwen3-8B DSpark speculator

DSpark (DFlash backbone + Markov logit-bias head + confidence head) draft model for Qwen/Qwen3-8B, trained with speculators (PR #677).

Preview/research checkpoint: online training on a 20k ShareGPT slice, seq 2048, 3 epochs.

Validation per-position acceptance (pos1-7): 0.689 / 0.541 / 0.440 / 0.369 / 0.319 / 0.283 / 0.255 | full_acc 0.415.

Downloads last month
91
Safetensors
Model size
2B params
Tensor type
I64
路
BF16
路
BOOL
路
Inference Providers NEW
This model isn't deployed by any Inference Provider. 馃檵 Ask for provider support

Model tree for mgoin/Qwen3-8B-speculator.dspark

Finetuned
Qwen/Qwen3-8B
Finetuned
(2171)
this model