If they were benchmaxxing, surely they would score higher than 30% on ARC-AGI. | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

wyre 15 days ago | parent | context | favorite | on: Claude Opus 5

If they were benchmaxxing, surely they would score higher than 30% on ARC-AGI.

conradkay 15 days ago [–]

Doing a quick search it seems like the average human score is 49%?

I view benchmaxxing as more of a spectrum. Mmaybe they're doing a lot more RL in environments similar to ARC-AGI 3, not even with the purpose of scoring well on any benchmark but hoping it generalizes into better performance on real, useful tasks.

Consider applying for YC's Fall 2026 batch! Applications are open till July 27.
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact