No, e.g. Yi-34B. | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		a_wild_dandan on March 18, 2024 \| parent \| context \| favorite \| on: Grok No, e.g. Yi-34B.

modeless on March 18, 2024 [–]

As far as I can tell Yi-34B is natively 16 bit float, the 8 bit version is quantized. https://huggingface.co/01-ai/Yi-34B#quantization

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact