Multiverse: Your Language Models Secretly Decide How to Parallelize and Merge Generation
Paper
•
2506.09991
•
Published
•
55
Autoregressive-32B is a baseline of our Multiverse-32B built on autoregressive modeling.
The model usage is documented here.
| Model | AIME24 | AIME25 | MATH500 | GPQA-Diamond |
|---|---|---|---|---|
| s1-32B | 35.4 | 25.8 | 88.6 | 48.0 |
| s1.1-32B | 52.9 | 41.7 | 93.4 | 62.6 |
| Qwen2.5-32B-Instruct | 15.8 | 10.4 | 80.4 | 47.0 |
| Autoregressive-32B | 54.6 | 45.0 | 92.8 | 61.6 |
| Multiverse-32B-zero | 52.1 | 44.2 | 92.4 | 63.6 |
| Multiverse-32B | 53.8 | 45.8 | 91.8 | 60.7 |
Thanks to the amazing s1 team for their s1.1 dataset as base data, and the Qwen team for their Qwen-2.5-32B-Instruct as base model.