Time to first token is as important to know for many use cases, rarely are peopl... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

bkitano19 on Aug 27, 2024 | parent | context | favorite | on: Cerebras launches inference for Llama 3.1; benchma...

Time to first token is as important to know for many use cases, rarely are people reporting it

Gcam on Aug 27, 2024 [–]

See here for our TTFT metric benchmarks: https://artificialanalysis.ai/models/llama-3-1-instruct-70b/...

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact