Would be great to have 6bit AWQ with repaired tensors.
#1
by slavap5 - opened
Could you please provide more details?
Never mind, it was qwopus with fixed tensors, but for some reason, the author decided to remove it. He claimed some tensors were "broken" and he fixed them.
Actually I think new Qwopus v3.5 is the best candidate for AWQ release: https://huggingface.co/Jackrong/Qwopus3.5-27B-v3.5