Spaces:

---

DontPlanToEnd

/

UGI-Leaderboard

like 1.69k

Running

https://huggingface.co/prism-ml/Bonsai-8B-gguf

Despite being 1/14th the size, 1-bit Bonsai 8B is competitive with leading full-precision 8B instruct models.

Alternatively, FP16 safetensors (HuggingFace format) of the 1-bit Bonsai-8B model:

https://huggingface.co/prism-ml/Bonsai-8B-unpacked

However,

We strongly recommend using the native 1-bit models instead.

Thank you! 🤗