Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Since it is MoE, quantized it could be able to run on cheaper hardware with just consumer networking inbetween instead of needing epyc/xeon levels of PCI-e lanes, nvlink, or infiniband type networking. Or it could even run with people pooling smaller systems over slow internet links.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: