When is the new fp8 version coming?
#4
by ca231321 - opened
When is the new fp8 version coming? Curious to see how good it is.
+1 thanks for the 4 bit is awesome, the 8 bit will be sublime.
Super anxious to try this. I know there are other projects that have already integrated the 4bit. And I have tested it a good bit. While good.... I think the 8bit will work even better with greater accuracy. I have a 12 GB card. Do you need a tester by chance? I would be willing to help test it if you need.
I am getting the feeling this 8bit version is not coming any more. It's been two weeks now and nothing.
ditto~ but let's give the gentleman some more time...
please don't include 8 bit in the model card if it's not yet available