The big difference will be measuring seconds per token instead of tokens per sec... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

reverius42 5 months ago | parent | context | favorite | on: Local AI needs to be the norm

The big difference will be measuring seconds per token instead of tokens per second.

martijnvds 5 months ago [–]

Seconds per token is just fractional tokens per second ;)

degamad 5 months ago | [–]

> fractional

Reciprocal?

Consider applying for YC's Winter 2027 batch! Applications are open till November 2.
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact