allenai/OLMo-2-0425-1B-Instruct
Text Generation
•
1B
•
Updated
•
27.9k
•
54
Quantized models with Windows ROCm llama-bench results
Note pp512: 4563.71 ± 55.46 | tg128: 135.19 ± 0.38 [UD-Q6_K_XL]
Note pp512: 2352.90 ± 40.45 | tg128: 111.49 ± 2.38 [UD-Q6_K_XL]
Note pp512: 639.56 ± 2.57 | tg128: 23.76 ± 0.04 [UD-Q6_K_XL]
Note pp512: 546.45 ± 33.03 | tg128: 19.44 ± 0.24 [UD-Q6_K_XL]