Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I run qwen 3.8 27b on my m5 mbp, with 48gb of unified ram and I’m getting around 10-15 tok/s.

3.6 35b a3b, I’m getting upwards of 100



Consider applying for YC's Winter 2027 batch! Applications are open till November 2.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: