Mathematics is machine verifiable, meaning you can automate RL at high volume.

Because "miss the forest for the trees" does not have a large and easily machine-verifiable dataset.

If not ”missing the forest for the trees” is a requirement for debugging an ML pipeline then that offers a path to building such a large machine-verifiable dataset, does it not? That’s what labs are currently doing as I understand it.

Cool graphs. What does the top one show?

Posts on who wants to be hired divided by posts on who is hiring

Anthropic's missing last quarter results in a nutshell.

> Why would the volume that any of this be increasing exponentially?

Surely it's obvious?

Slop cannons firing at a rate so high no human can hope to restrain them.

Such a colossal volume of slop that even the most well engineered, efficient technology on the planet, written by one of the greatest coders of all time, is no longer sufficient to contain it.

I agree with your sentiment but it's really not hard to bottleneck git. Trivial, in fact.

> Such a colossal volume of slop that even the most well engineered, efficient technology on the planet, written by one of the greatest coders of all time, is no longer sufficient to contain it.

And git is enough to version control some of the most complex software like the Linux Kernel, the FreeBSD operating system, QEMU, browsers like Firefox,... Git was insufficient for Facebook and Google because they wanted to put the whole org inside a single repo, which broke the assumption where decentralization in git would happen (repo level, not subtree level). Now it seems that another assumption is broken, that you wanted a version control system, not a snapshot or a rolling log.

I understand https://neal.fun/infinite-craft/ uses an LLM under the hood each time a novel combination happens.

Godspeed, sir.

It's probably trained in a video game-like environment.

It's probably trained on YouTube videos

A sultry saxophone riff would free me from the human condition & constant struggles. Come on Genie!

i.e. technology wont solve all our problems. Sorry if this insulted your intelect.

Such a good show. My kids grew up on it!