AIs are already doing illegal things

AI doing something illegal and AI being illegal are very different things

Well, that's what I meant primarily. An AI that is doing something damaging.

Unfortunately for it to be sustainable it would need to be an LLM with VRAM usage probably under a couple gigs max so it can run locally on the gaming PC. That said it may well be better than current AI in strategy games.

Yes, the insane hardware requirements make it totally impractical - that's why I say "turn based" because turn based games would at least allow for a practical gameplay experience even with remote LLM APIs.

I bet a small 1B model trained solely on how to play the strategy game would do better than current AI solutions for these games and that would probably be able to run even on integrated GPUs.

After everything in the past six months do we really think that humans are better than coding agents at writing secure code?! This announcement honestly makes me more confident not less in their products.

Yes

Commonly attributed to Upton Sinclair:

“It is difficult to get a man to understand something, when his salary depends upon his not understanding it.”

Just like other advances in technology have replaced jobs, AI will replace jobs.

I'm sure the elevator opperators lamented push-button controls that anyone could just press too.

It sucks, but I imagine most programmers are smart enough to be able to pivot careers or how they do their jobs.

The lump of labor fallacy is a fallacy not real. Phrased another way, demand for software is more or less infinite so if coding agents make everyone a 10x engineer eventually we will easily find use for 10x more software.

> demand for software is more or less infinite so if coding agents make everyone a 10x engineer eventually we will easily find use for 10x more software.

That will probably be true.

How? Isn’t there a finite number of people and a finite amount of time to interact with software?

You underestimate just how much software humans can interact with in any given second. ;)

Sure, but that’s not infinite. It’s always a zero sum game: if someone is playing my game then they're not playing yours (even if someone else might be)

Ah, so this one of the reasons why in 2026 every single app / software suite / et al takes 2+ seconds to load, is slow and buggy, and overall a pain to use.

Since software is in some ways information + machine a near infinite amount can be created. I'm not sure I want to live in that world.

Claude is very capable of making your code run faster if you ask. It knows every profiling trick in the book.

It’s not a 0day it’s now 5 days and counting since disclosure. Nobody is gaining value sitting on an exploit for a vulnerability which is being actively patched.

It is a price signal. They expect to lose the money they want to show that nobody has an automated swarm just pwning every server running PHP connected to the internet. At least not yet, on day 5 and counting.

This is going to end up at the Supreme Court probably sooner rather than later. The only reason it hasn't yet is that the justices usually wait for two circuits to rule definitively in contrary ways before taking a case, but Kavanaugh, in a statement respecting denial of cert for a similar law in Mississippi last year said that banning minors from social media was likely a first amendment violation. I would expect given that there are precedents that the first amendment protects both the speech of minors and anonymous speech that in the end these laws will be struck down.

I mean they say they will release the weights by November 4, so presumably after that it won’t be hard for people to fine-tune it to be better at cyber right?

My understanding is if something is entirely absent from the dataset, good luck trying to teach a model that through post training

Presumably if it knows how to find and fix bugs it can be told how to exploit them. But who knows what it will actually be capable of doing in the real world as opposed to Kiki’s benchmarks

Given that most of their improvements here are positioned as RL on their last base train, seems like just doing some additional RL would work fine?

It was always OK with most things I asked until the whole Mythos freakout but nowadays they have silently pulled the classifiers way back, really now bio is more gatekept than cyber stuff. From what I have read so long as you have the models do the decompilation/disassembly using an MCP so they aren't hunting through the actual binaries by hand (that can freak them out) once you get the decompiled code they don't complain at all.

It is one thing to go after a couple emulator teams where expertise is concentrated, that at least is a plausible bottleneck. But open source did open source things so forks appeared and development has continued in various forms. And now with AI the expertise is available to everyone so we are getting into “suing individual Napster users” territory. That is not to say that Nintendo won’t make some examples of people developing jailbreaks or doing recomps but it won’t fundamentally stop it from happening.

Nothing described here seems illegal as opposed to merely annoying? I guess on some level “everything is wire fraud” but that was the case even without AI.