Hacker Newsnew | past | comments | ask | show | jobs | submit | Dfol's commentslogin

So YES if you're using Cowork or Chat


No, because they are cached, the inference cost is paid once per model, does not scale linearly per user or use.


So the people using the Claude consumer chat products pay for them via usage...

That's not any better. It's actually worse.


I don't understand.

System prompts are part of the software that customers pay to access.

Complaining about that is a bit like complaining that your Netflix subscription includes paying to execute the compiled code that Netflix wrote that serves you video streams from their servers.

Actually there is a difference: If Anthropic deleted a large chunk of that system prompt I guess you might get like a 1% increase in how much Opus 5 you can use via their chat allowance for your paid subscription.

Is that really something worth being frustrated by?


Cached.

they are the first part of the input and it contains no user dependent variables, so the model is in a known state that it can reuse across all users, it does not need to recompute all that inference


Unless they are using a linear architecture, the compute cost still scales O(n²) for n tokens, and nemory cost scales O(n).


>the compute cost still scales O(n²) for n tokens,

That is never the cost, it's a common misconception.

Cost scales linearly per tokens. Unless you are sending one token at a time and avoiding using the same machine or cache.

Just look at api charges, they are charged by token, not by token squared.


Which seems to contradict the usual consensus that purely linear architectures are not sufficiently capable and unsuited for frontier models.


Fable was great. For some reason it has been terrible for the past week. wtf is going on?


What have you been observing? Genuinely curious; I use Fable as my main model and haven't noticed any regression.


Of course they do. They've already mined the web, books, media. The brain is the last frontier and the most lucrative.


But think of all the ad revenue they could make!

But in all seriousness, i hope this tech is used for more things like Neuralink that actually improves peoples lives.


I'm shocked...

You cannot easily regulate a generation that understands technology better than the regulators do.


While most regulators do not seem to demonstrate the slightest understanding of technology, my experience is that young people have incredibly low understanding of technology.

They have been using simplified overly abstracted systems their entire lives. When I teach an HTML class the first thing I have to do is teach most of them the meaning of “save a file to a folder on the desktop”. A majority of the class will have no idea what any of that means.

If you’ve been using chromebooks or tablets your whole life, you really don’t know much about computers at all.


In what way did OpenAI lose it's "AI Crown"?

I use both and like both.


It won't work.

Most of the media you see in the near future (if not already) is going to be at least AI assisted. They're going to be overloaded by reports of AI generation not labeled as AI.

I'm also curious, what about AI assisted media? If a company writes a full article, then uses AI to edit it a bit, does that need to be labeled?


Smartphone cameras also do a bunch of image processing that can be classified as AI, by default (some more than others). I wish they'd stop doing that, but I'm sure they won't.


I agree it won't work, albeit for an entirely different reason. There has been a shift towards labelling AI generated or AI assisted content by those who aren't attempting to mislead. Those who are attempting to mislead won't.

As for AI assisted edits, the article is quite clear about the labelling covering AI generated content. If you "hire" the AI as an editor by asking it to check your grammar or point out weak arguments, then do the rewrite yourself, it almost certainly wouldn't be covered. It sounds like it wouldn't be covered if you asked it to apply edits for style either, just be sure to log the changes since it would clearly be in an AI's voice.


> Those who are attempting to mislead won't.

Sure, but this mandate means that if they're caught (which isn't unlikely), they can be fined up to 3% of revenue (not profit). Many will be outside the EU's jurisdiction, but not all. Taken together, this will have a chilling effect, not stopping it entirely, but likely reducing it.


It could turn out like the California “chemicals present that could cause cancer” that are ubiquitous in California, and therefore not useful as signal.


Speed limits work nonetheless. A few hefty fines and most of it will stop.


> It won't work.

Maybe. But the rest of your post doesn't have anything to back this up.

> I'm also curious, what about AI assisted media? If a company writes a full article, then uses AI to edit it a bit, does that need to be labeled?

Why would it? The threat is mass generation of articles without any human oversights, and realistic looking images claiming occurrence of events that never hapened. Nobody cares about an AI typo and stylecheck.


I would hope so.


Not surprising. They haven't mentioned it for months. I assume they want users to use the in-app browser instead.


Wow, how convenient that the "community" ranked your own site the "best service"...


Ha, fair catch. That's from testing during development and shouldn't be ranking. Removing it now.


It's working great for me.

I generally prefer OpenAI. I usually start projects with Codex; I love the plan we created. Then, after about 2 hours of working, back and forth, etc.I realize it's drifting HARD, or getting stuck on relatively simple things.

Once I get frustrated enough, I sometimes start over with Anthropic. Anthropic has been better (for me at least) to work with from start to finish.

I have the $200/month plan for each of them. (And I used to have the $250/month plan for Gemini... lol?)

Both Fable and Sol are good and definite improvements. I don't have a favorite yet. It's too early to tell.

The biggest difference I'm noticing is usage.

Anthropic is like a used car salesman. Not allowed to do a basic check on your own car (website), they'll scrape every penny possible out of you. Low limits, high api prices, trying to keep everything in their system.

OpenAI is like a cool but aloof dad. Go ahead and borrow his car, shoot, he'll even pay for your gas every once in a while. He'll answer your 5th question drunk, forgetting what you asked. But, at least he's a nice drinker that buys the group shots.

I have to watch my Fable usage, and I'm sure as hell not going to pay API prices. I don't have to watch/worry about my Sol usage even in Ultra.

But, 1 thing I'm noticing using Sol Ultra (on fast mode) is that it's slowing WAY down after a bit. I work the opposite of peak times so that's not it.


May I know if it’s for hobby projects or you run your own business/company where you use subscriptions.


Both.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: