Seeing ~70 tok/s on a 7900 XTX using Ollama. | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		genpfault 4 months ago \| parent \| context \| favorite \| on: Open models by OpenAI Seeing ~70 tok/s on a 7900 XTX using Ollama.

Matsta 4 months ago [–]

I'm getting around 90 tok/s on a 3090 using Ollama.

Pretty impressive

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact