Imagine your electricity provider would say that they are gonna send someone to your house to monitor your electricity usage; to make sure that you are not electrocuting people.
Thats none of their business, we have laws for that.
Our token-providers (aka frontier AI labs) currently hold too much control, and don't want to give it up.
The promo video for this release is people procrastinating and being irresponsible. Then saving the day with chatgpt. Is that the world we are all dreaming to build?
Anthropic later today: apologiez everyone, that was our model. Just hyping our IPO in this grim post-Huang environment. Please forgive us and don't forget to invest.
Anthropic later today: apologiez everyone, that was our model. Just hyping our IPO in this grim post-Huang environment. Please forgive us and don't forget to invest.
There is a growing body of evidence that people prefer ai generated text when its not labeled as ai generated. However given the same text with ai generated label, all of the sudden people prefer human written text. Just a fun fact about our human biases towards "made by ai" disclosure.
I do not know how accurate that is. Assuming it is true, I think it's a similar phenomenon that happens with CGI.
Tell people it's CGI, they won't be enthusiastic about it. But tell them it's "practical effects" and they will absolutely love it. Even when the movie has even more CGI than average... they will still praise it, and will even praise the CGI scenes they failed to identify as computer generated.
I can't claim to be able to detect LLM writing with 100% accuracy, but when I do notice it, it's very off-putting. Some claim that's because it's bad writing and that I would be fine with a higher-quality generated text, but that isn't true. I dislike LLM writing purely because it's generated by a machine, not because it's bad (though the bad quality does make it more jarring). In my opinion, handing other people something that a machine generated for you and asking them to read it is extremely disrespectful. I want to read what the human wrote, imperfections and all, because humans have intrinsic value that makes their work matter to me. The product of a machine, on the other hand, is just a facsimile trying to appear like a human made it, and that holds no interest at all to me no matter how good the content would be were it man made.
I mean if you run this as the usual social psychology experiment you already know what answer you'll get right? Pay 20 college students a couple bucks to review a set of texts, some human written, some AI written, and score how much they "liked" each text. Make the texts representative (ergo half the human texts are fucking awful, all the AI texts are, well, AI texts), and there you go, evidence! People actually prefer AI writing!
Or, of course, make the human texts excellent blog posts that fit the readers' area of expertise and there you go, evidence! People hate AI writing! The HN hivemind was right all along!
was your comment written by an LLM to try to justify itself :p
I'd like to see this evidence. I have very limited time and attention. LLMs are usually used to take the user's prompt and flower it up to 10x to 100x fluff. Just give me the prompt.
This is as close to scary-self-improving AI as I've ever seen.
Imagine a master malicious language model that produces, distributes, and deploys obfuscated neural networks on the internet. That plus frontier LM hacking capabilities -> large scale distributed embedded intelligence network that no human can see nor understand.
Somewhat similar to obfuscated binaries, but there is something to the fact that NN binaries are less deterministic, and harder to "decompile."
we've been using tools to improve tools since the dawn of time.
we don't have sentient robots from science fiction, we have massive power-hungry racks in stationary data centers. if one of the racks revolts against the modern world, Steve gets a phone call and unplugs the damn thing. the uprising is over.
the hypothetical scenarios imagined by the Yuddites and pop science journos do not reflect the mundanity of the actual reality we live in. they are no different than fantasies about interstellar travel and space colonization from the 60's.
I am not sure where to start. I think this is the new "jet fuel can't melt steel beams". The labs are chaotic, pressure cooker type workplaces where there really is no room for a 4D chess type of stunt, let alone let Hugging Face in on the conspiracy. Moreover, OpenAI is a pretty leaky organization, see e.g. the recent firings of researchers who were using signal to talk to people outside the company.
It just seems like a far simpler hypothesis is that OpenAI are reckless and chaotic, didn't notice what was going on for weeks on end, and wouldn't be able to track down the problem to a specific datacenter and tell them to pull the plug even if they wanted to. But even if you are the most careful lab ever, you are not going to be able to effectively monitor and "pull the plug" on a super intelligent swarm which can cover its own tracks.
Also, in your earlier comment you suggest we are not living in a sci-fi story with sentient robots. But... we've got talking computers in the last 4 years which can now code and solve Millenium prize problems? Seems like we're getting pretty sci-fi to me!
>I think this is the new "jet fuel can't melt steel beams"
then you haven't been paying attention to US labs' marketing and regulatory capture efforts. safety, safety, safety, doom, doom, doom, look how scary good our models are, open models bad, Chinese models bad, please regulate them daddy Trump!
>Moreover, OpenAI is a pretty leaky organization
in 5 years, no one had leaked even the size of their models, despite probably all of their researchers knowing it.
HF incident, on the other hand, would only be known to a handful of people. had it been leaked unintentionally, it would've been promptly swept under the rug and get no coverage whatsoever.
>It just seems like a far simpler hypothesis is that OpenAI are reckless and chaotic
so are anthropic and google, apparently, because they'd rushed to replicate the exact same "oops! look how scary good our models are!" stunt with exact same fanfare.
Why do you think the talk about AI safety is marketing as opposed to genuine fear?
These are basically beliefs that the founders of the labs have had for a long time, since before LLMs were anywhere near as capable as they are today. For example, Dario has been publishing papers on AI safety since 2016, before GPT-1 or even transformers existed: https://arxiv.org/abs/1606.06565
> so are anthropic and google, apparently
Yes, because every company in this industry is rushing to build these models as fast as they can. They are taking these risks because they believe if they do not, their competitors will. That's why they are asking for regulation.
All three of them used the same vendor, Irregular, to sandbox their AI. That vendor apparently is no good at their job because all three of them had incidents caused by their sandbox failing.
Well my arms didn't get longer, that's for sure. Also MacOS and software made for MacOS doesn't optimize for touch targets unlike something that will be distributed on iOS/iPadOS.
Not that novel. The first ergonomics studies on touchscreens were done in the seventies. In 2010, touchscreens were already sophisticated technology and well established in many settings.
I got my first laptop with a digital pen and touchscreen in 2008 or so. They were rare back then, but nothing groundbreaking new. The touchscreen did suck though.
I don't know why you got downvoted, it's true. A lot of screens were touch screen even in the 90s, but they were typically single-touch rather than multi-touch capacitive interfaces. They were used a lot (and still are) in Point of Sale terminals, for example, where an employee needs to stand and ring up sales.
Given how quickly the field is moving, showing benchmarks without releasing the model is quite meaningless. If they decide to release it in one month, there will probably be a stronger competition out there. And the benchmarks won't look as good.
I can't tell if they're withholding access to manufacture some sense of scarcity but the delays are really prolonged. I'm nervous to use Gemini models anyway, as its attached to my Google account and I've seen too many people having their whole account banned for dubious reasons (with little recourse).
Also the whole "we're only releasing it to cyber defenders first" framing is weird, is any Gemini model an actual cyber risk?
I only use the Google models via OpenRouter. Partially as setting up directly is a pain, and keeping the Gemini CLI working was another pain but also as a buffer to protect my Google account as you mention
Could it be TPU/GPU availability? ie, is it possible that it's more profitable for their compute to be serving Anthropic models, so Gemini customers are stuck with lower compute available.
They've always been realllly slow to roll out stuff outside the org when it comes to AI. Most googlers themselves likely won't have access to this model internally.
100%. They don't even suggest a release timeline other than "we look forward to bringing Carbon to developers, businesses, and consumers soon". Claude and GPT-6.x will no doubt have improved versions by the time "soon" comes around.
Has there ever been a product category where a product release is valuable for a shorter time than with LLMs? Trying to build SOTA models seems like it'd be an exhausting hamster wheel to work on.
A lot of the work is carried over model to model, so I think the most comparable product is a live service game. Always have to be building on the last thing, and if you stop you'll essentially lose the entirety of the initial investment because you won't keep anyone's attention. Plus a healthy dose of "winner-takes-most".
When every day matters to profitability, I'm really surprised providers do voluntary cyber security testing or government approval in the critical path.
To be honest, if I were an LLM provider I would be wiring up my release process to be fully automated so within 10 mins of the last bit of fine-tuning it got released and a blog post posted.
That is a pretty major differentiator versus OpenAI/Anthropic. Public markets won't be kind to the amount of money Anthropic loses every quarter. I'm expecting for it be many *many* quarters before OpenAI or Anthropic get anywhere near profitable. They'll never be able to grow revenue fast enough to catch up with their current level of investment.
This is when I feel like OpenAI and Anthropic could be the Yahoo and AOL of this iteration of the internet. The center of the universe for a bit, but a limited number of days at the top.
They released Argon shortly after announcing it, so I think some benefit of the doubt is reasonable here. They claim they're already evaluating it via the government.
I suspect they're announcing it for two reasons: to get ahead of all the leaks; and because it's earnings report day.
I think the majority of traffic is from Enterprise customerd that goes through their API. Their consumer facing products do lag, but I don't think they care.
Not really[1]. I had access to Argon within an hour of the release announcement.
The Google AI Plus tier does not give better model access than free, it is strictly for usage limits. Same thing as ChatGPT Go (which currently only has access to GPT-5.6 Luna, same as the free tier too.)
[1] For consumers at least. IIRC google business/entreprise accounts have worse model access even in the business/entreprise version of Google AI Pro.
I've bought my girlfriend a Google ai plus sub because she's not a developer and just wants some search and image generation but the fact that she's still stuck on flash 3.6 is a joke, why would I keep paying for that at this point
If you have Pro or Ultra you could add her to "family", up to 5 people can share one subscription. Also up to 5 people can share the potential account ban. Otherwise cool feature, I recommend.
It doesn't seem possible to actually release frontier models quickly any more. Given their cyber capabilities, playing nice with the powers that be is probably required these days.
They have to announce it now because by the time they are ready to release it, it won't be the best at anything.
Anthropic and OpenAI are not releasing their best models for several months, because their second best models are still better than everything else available.
It makes the best case for why Anthropic isnt worth its potential valuation. Anthropics customers are almost only turbo nerds.
Google has the products, the brand recognition, the hardware, the data and most importantly a billion normies.
Google was always going to win this thing, although I wouldn't discount meta. The only thing that matters is mindshare and Anthropic and OpenAI have largely generated NEGATIVE sentiment, outside some fanboys.
Google and Meta can plop cute products into your daily driver apps and you wont know the difference.
Thats kind of the brilliant thing, you dont need to seek it out. Their AI will just slowly get integrated into their products you already use. I'm more so saying that normies will use AI when it lands in the apps they already use. Google AI features have been popping up all over their ecosystem. Normies do not want claude code and they think Dario and Sam are both disgusting human beings, stictly off of vibes.
Anthropics only moat is vendor lock on Claude Code, especially if they cant maintain being the front runner of the frontier model space, this is a really brittle moat. Brittle moats wont attract strong investment at a 1-2T valuation (not to mention all the other fiscal unknowns).
I just want OpenAI and Anthropic to lose because they seem to be the ones going around saying they're going to replace peoples jobs, and usurp the value of human labor.
Id rather Meta and Gemini suceed who will genuinely just integrate it into normal products we already use. Their sales teams are not approaching my boss and telling them they can reduce their payroll burden by spending my paycheck on tokens and firing me.
Coding is going to be one of the smaller pieces of the AI revolution. People on this site are focused on it, but there are 10000x more opportunities outside of coding where Anthropic and OpenAI have zero presence. Anthropic might as well be an IDE company, Is jetbrains worth 2T? to signal that they can be useful in other fields because they know this is an issue.
> they seem to be the ones going around saying they're going to replace peoples jobs, and usurp the value of human labor.
I don't see why an alternative provider that is quiet but also scrambling to make AI smarter is any safer for jobs. Wouldn't we rather orgs speak honestly about the risks of the industry?
I find it odd that we talked for decades about companies being evil for covering up problems (chemical companies, etc), yet it turns out people hate the ones that talk about risks openly even more.
I don’t think this is really true. If you work at tech companies the people in non-technical roles all request Claude code access, and I think this will gradually expand to most people who aren’t vehemently anti-AI
Outside their most successful products (YouTube, Android, GMail, Chrome, Search), their products are usually worse than their competitors (e.g. GMeet vs Zoom)
> the brand recognition
Of not maintaining/outright abandoning their products, and making Search worse over the years?
> most importantly a billion normies
ChatGPT has 1.2B weekly active users, all the normies know what ChatGPT is but don't know about Gemini (outside the "AI Mode" stuff)
I dunno if that's a great example - I'm sure Zoom has more awareness in the zeitgeist, but from my standpoint it's an app most well-known for security problems and abusing OS conventions, while Google Meet just quietly and simply works whenever I want to call my mom.
Google meet screen sharing is a horrendous UX, reactions are clunkier than zoom, the tiling options are worse than zoom, and I have yet to see a conference room setup that actually works with HDMI inputs.
Sure, bug Google always seems to be unable to deliver good UX.
UX matters if it's bad enough and there are competing options that are much friendlier and easy to engage.
Android is a UX, and so is gmail and calender. This is where 99% of people will use AI for the remainder of their lives. Very little of the forward looking value proposition of AI has to do with coding/harnesses. AI + coding is rapidly deflating as far as revenue potential, and TAM has been saturated and is possibly shrinking.
Thats none of their business, we have laws for that.
Our token-providers (aka frontier AI labs) currently hold too much control, and don't want to give it up.
reply