You could try running the smaller QAT Gemma 4 models but I doubt they'll be very... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

alimbada 3 months ago | parent | context | favorite | on: Ask HN: Has anyone replaced Claude/GPT with a loca...

You could try running the smaller QAT Gemma 4 models but I doubt they'll be very good for software engineering work.

euroderf 3 months ago [–]

Thanks for the reply. What I'm getting from numerous HN discussions is that 8GB is a hopeless case (and the money I saved on RAM should be spent on non-local coding assist).

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact