FP4?

#5
by alexcardo - opened

Can you please release gemma-4-31B-it-FP4-AutoRound

Thank you.

Intel org

Thanks for your interest in our quantized model. FP4 is not currently a priority for us, although we do support MXFP4 and NVFP4, and our algorithm shows clear advantages in our benchmarks. For now, we recommend generating the FP4 version yourself.

Sign up or log in to comment