Games are designed to incentivize you to stay in them. Real life has you as a captive audience, and to the extent that it's "designed", it is designed by people also playing the game, against you who have no incentive to encourage you to try harder to beat them.
Well hang on, "just work" implies an objective standard of correct vs incorrect. No such standard exists. I'm sure that there will be legal AIs that reliably do... something... but the whole point of the legal system is to allow space for humans to argue their case. If an AI "does legal" deterministically, without human intervention, how can it be said to be "working" if its very use defeats the purpose of the system it has learned to navigate so expertly?
Your example evidence set is actually quite robust by US justice system standards. There are countless cases of innocent people getting sentenced to death for e.g. being the one to report the murder, often in the face of strong circumstantial counter evidence.
>a BBC spokesperson said: “In line with our editorial guidelines, we advise that no badges, flags, and emblems or symbols are worn or visible during filming, along with clothing with obvious branding or slogans.
Oh sure. In a few weeks the BBC will be drenched in poppy pins. I'll wager my left nut they won't edit those out.
>the sandboxes themselves may need to be kept up to date
The sandboxes don't need internet access to be kept up to date. They just need to be writable by something with internet access. There's a million ways of doing this. Run things under a hypervisor. Have a PXE boot server in your data center that serves an "updater" boot image, after performing host attestation. Or if you really want them to "update themselves", physically plug em in for the update, physically unplug them the rest of the time, and don't run updates during agentic testing.
>or may need to be monitored
The sandboxes don't need internet access to be monitored, they just need to be readable by something with internet access. Like a hypervisor, KVM. or a webcam pointed at the screen, in roughly ascending order of paranoia.
>or the sandboxes may need to updated
Did this one already! See above
>or they may be connected to specific services
That's just "not airgapped" rephrased.
This is just off the top of my head and I'm no infrastructure engineer. OpenAI saying "it's too hard" is a major cop out. The real reason is that they show no signs of actually giving a shit about AI "safety".
There isn't infinite time left in "eventually" - maybe a billion years, out of 4.5 billion passed so far. A billion years is about how long it took to go from "multicellular colonies" to "concept of an animal". So no, not guaranteed to bounce back from mouldy radioactive slurry.
If you had been asked, in 2016, to describe the behavior of a "probabilistic database", I very much doubt you'd have described the behavior of 2026 LLMs. They are deeply surprising in many ways.
reply