Goodhart's law would seem to apply:

https://en.wikipedia.org/wiki/Goodhart%27s_law

Nevertheless, scoring so well on this benchmark is an accomplishment, though I'm not in a position to evaluate how significant it is.

Nothing beats an actual human spending a couple hours with the model when it comes to meaningful evaluation.

that's why the huggingface llm arena exists