Hacker Newsnew | past | comments | ask | show | jobs | submit | stateofinquiry's commentslogin

I hate to even put this out there, but "OS-as-a-subscription" (OAAS) could be a way. Your Claude payment covers all the software running 'your' computer, plus the ability to develop new 'apps' for specific needs on the fly telling the OAAS computer in human language what you need. Throw in services like email and cloud storage and some customers might find such a bundle attractive for the right price. It would suck revenue away from MS, Apple, Google. Enough to justify this valuation? No idea.

It seems you are suggesting that if a private corporation (a foreign one at that) is large enough it should ignore the law of the country its operating in. I don't think you will like the consequences of such a situation, and will charitably assume you have just not thought your message through for even a second before posting it.

PS: If you think the British gov is authoritarian.. well, you might not know what the term means and/or anything about the spectrum of governments operating today or in the past.


If laws aren't transparent and reasonable, you shouldn't necessarily follow them. If I were to sell encryption software that's banned in Kazakhstan, you wouldn't expect me to stop selling to customers there, would you? I see no reason why the United Kingdom should be treated any differently than Kazakhstan in this case.

The British government is certainly not as authoritarian as those in China or Russia, but that doesn’t change the fact that it’s still terrible and restricts people’s rights. For example, you can be detained for as long as they want if you refuse to unlock your encrypted device.


You may be confused, so I'll try to illustrate the situation.

Supose you live in USA, your chickens have a list of laws, those laws apply to USA. If you try to sell those chickens in UK or Europe you'll find that your company will not be allowed to operate, and if you continue someone will go to jail.

Maybe digital products have an easy way out, but apple is not digital and they may need to find a way to comply.


To be more charitable, I think they're more suggesting that Apple should call the UK's bluff, knowing that democracies have to be accountable to their citizens.

Can Apple afford to lose the UK market? Almost certainly yes -- it's a fairly minor global player. Can the current UK government afford to deal with the massive fallout of banning all Apple products right now? That might be, as Sir Humphrey Appleby would say, a very courageous move.

In other words, Apple could simply state that in order to protect their users they cannot and will not do this, and will withdraw from the market rather than comply. That puts the onus on the UK government to either put up or shut up.

It would be fascinating to see how this would play out. Would "think of the children" and "OMG, terrorists!!" win against, "but I still want my iProducts"?


Thank you! That sentence also jumped out to me as the solution: Apply civil and criminal liability to the creator and/or operator of these agents using the laws we already have. "Escaped containment and hacked another company's database" = Individuals who created the models and those who set them to work are charged and put on trial for the hacking. Just like if a human had done it by hand. Someone must be liable, and it should not be the model- because the model is not a person.

If this is done systematically (i.e. in jurisdictions across the world) I believe the problems will be solved in short order; we won't have to mandate what sort of training is "allowed" or not, "safe" or not. The creators and users will sort these themselves, as their incentives will be properly aligned (i.e. they are liable for what the agent does). I am confident that this approach would see a great blooming of very trustworthy AI models.


No ... there is no need for 'escaped containment', there are no 'agents'.

That's just jargon.

It's just software

We have all the laws we need.

If some company ended up doing some horrible thing, we would not say 'companies software exposed 1 Million identities'.

We would say 'ABC Corp. exposed 1 Million entities'.

There is no 'agent'.

ABC Corp 'did it' ... or the individual in the org 'did it'.

The 'gun' did not 'shoot' the other man; we say 'a man shot another man'.

That's it.

And yes, Dr. Bengio is bit odd with all of this.


Note that we already already apply this principle not only to software, but also to some sentient beings.

If your dog kills someone, you are accused of murder.

[at least, in the jurisdiction where I live]

If your dog gets this treatment, why not your AI?


This goes all the way back to Old France

There was a sow in Falaise in northern France that killed a kid in 1386. The town dressed the pig in a bonnet and hanged it after sentencing the pig itself and not its owner

But… maybe that’s just medieval nonsense


I mean I think there’s a similar level of judgement required.

Was the owner negligent in controlling their pig/dog/AI?

Was anyone else negligent along the way?

For example if the pig was just a normal pig, the owner cared for them normally, and there was a freak accident where the pig escaped and happened to kill a kid? Obviously nobody at fault.

If you have a dog with a history of violence and let it walk around off-leash with you around town, and it kills a kid? Absolutely the dog owner was negligent and should be charged.

Did you buy an AI sold to you as secure and the provider implies that it’s in a sandbox? Provider is on the hook for the damage.


And this is where your analogy breaks down, because there are few natural analogues for the sorts of systems we are developing.


Too generous. CEO Of $CORP caused millions of innocent people's lives to be damaged


I'm inclined to want to agree ... but that's not how it works with limited liability corps.

At least we have laws for what OpenAI 'does' to others, in whatever form.


We can report it however we want regardless of how it may or may not be prosecuted


Firstly it's very difficult to press criminal charges when the victim is uninterested. It's not clear that HuggingFace would want criminal charges against OpenAI, especially to set a precedent that could easily be used against HuggingFace in the future.

Secondly you'd have to convince a jury either that OAI intended to hack the targets, or that they were criminally negligent. Intent would obviously not be provable since they likely didn't, in reality, intend for it to happen. Regarding negligence, OAI's attorney would argue that the agent was in a sandbox, that industry-standard security protocols were followed, etc. It would not be anywhere near as much of a slam dunk case as you're imagining. It would be similar, for example, to an assault case where someone's dog broke off of a standard leash and attacked someone.


I can't say it enough how angry it makes me that a kid i knew in high school who anonymously reported a vulnerability on his college network was hunted down and given federal charges, yet not one single person at OAI or else will see even the threat of consequences for deliberate infiltration of random networks.

Copyright immunity was one thing, annoying yes but naturally a civil matter, this shit is a different level


Agree! My only concern is - is the judicial system fast enough, and resilient enough? Or will these creators get "off the hook" by using their agents to find loopholes, sway public opinion or even convince Trump to grant them immunity?

Still, I have no idea why OpenAI & co. are not being sued for these hacks.


My opinion and based on my observations: The recent track record with courts, prosecutors, and lawmakers keeping social media companies accountable is a relevant case and does not encourage me. It has taken a long time (decade +) for society to recognize the harms and finally start holding some to (partial) account. If you want an older precedent, the tobacco companies were able to dodge liability for multiple decades after knowing the harms from use of their products.

So, your question is spot on- I think the speed will be an issue. On resilience, I am more optimistic.

The old quote, "The wheels of justice turn slowly, but they grind very fine" (as well as I can remember it) seems to apply. I expect lawsuits to start landing in the coming years.


Tobacco companies 'liability' is completely different scenario.

They were held responsible for basically misleading people, and that's 'complicated'.

If OpenAI 'software' goes out and does something, it's OpenAI's fault.

If Walmart revs up a truck, points it downtown, and 'lets the truck go' ... that is Walmart's fault.

There's nothing complicated about liability, no need to see their internal emails, no need to gather 'intent'.

This not like Instagram 'social harms' either, which is more like Tobacco.

We don't need complicated thinking - agents are not externalized for their controllers.

'It's just software'.

The fact we're even having discussions about it just crazy frankly.

OpenAI broke into HuggingFace, that's it.

HF can sue them, or not, or whatever.


> Agree! My only concern is - is the judicial system fast enough, and resilient enough?

We already have the laws. It is just software. But somehow people are confused that it is not.


> the EU a de facto open air prison for him.

de facto a person can take a train into Switzerland from the EU (France, for example) with no border control. Or arrive by car. Once in Switzerland flights out are possible for a Swiss citizen. So I believe your statement is untrue.


Probably the fact that most of the readership of the article and this site were alive for the former but not the latter. One could equally pin the rise of Joe McCarthy as the moment America started its move to "autocracy". Or when Roosevelt interned Japanese Americans. Or the civil war. Or the Mexican-American war. In fact, the struggle is constant (as mentioned downthread).


I'm not sure if you are saying one can or can't express opinions on airliners.. but I do want to point out that the "contract of carriage" of most airlines is more restrictive than you might find for a ticketed event like a concert. You might want to read the one for United, just for fun (especially if you fly). https://www.united.com/en/us/fly/contract-of-carriage.html Rule 21, item H 16 even indicates that you can't smell bad. YMMV, but it is pretty far from a "public" space as I define one.


Yup. I have not tried using a non-GoogleAndroid or iOS smartphone, but what you describe perfectly reflects what I experienced when I went started to work for a large employer 16 y ago. I had been using Linux as my main OS on desktops and mobile computers for at least 15 y by then. Slowly the grind of hacking my system to access the VPN, check email on their Exchange server, open MS Word docs.. it all pushed me to MacOS from about 2015 - 2021. Eventually I could not abide by Apple's incompatible hold on my data, Gatekeeper (I really hate the concept that they must approve software I want to run on my own hardware) and the unrepairability of their machines.. so I am now on Win 11. Right now, considering the trade offs, I think this is the best choice. I see a lot of people extolling Linux lately, so maybe it is time to try going back.

Back OT, smartphones were always less open than the general purpose computers of yore. And it looks like they are increasingly a requirement for participating in many societies. In general I don't find this a good thing, but have little faith that regulators will 'solve' is because they have their own pitfalls (recent examples from EU: age verification and chat control).


I did switch from MacOS to MS Windows in 2023, after being on MacOS from 2015 (and various Linux distros between about 2000 and 2015; before that, Win98 and earlier versions, so help me God).

I did not think anyone would be interested in reading about any of this, and reading the article reinforces my hypothesis.


Interesting points. With the extreme cheapening of the cost (time/skill) for software production, we can have "Extremely Personal Software", as you mention and as demonstrated by the source. I wonder if we will reach a stage where "software" is written by a computer for an audience of 1 and for a single task, to be run once only- via an interface that works for all tasks. The very concept of software as something that users have to learn to use (memorizing keybindings, for example), might go the way of the punch card.

More like Star Trek, we would just ask "computer" to do things, and its machinations (and "software") will be invisible to us. We would just have output to deal with.

I think this would mean a lot of things. I'm sure I can't fathom all of the implications, but it sure makes me feel old! Interesting times ahead.


LLMs seem to be great for speeding up the creation of things that aren't all that hard to write in the first place.

They don't seem to be helping much with difficult tasks.

Text editor? Easy. That used to be a rite of passage. Lots of people have written their own basic text editor.

3d solid modeler? It's always been difficult and AI coders aren't (yet?) up to the task. Most open source CAD projects that show up here are layers on top of OCCT (Open Cascade) which is pretty far behind what commercial geometry kernels are capable of.


More likely we'll have a library of skeletons for single task software, where the LLM can fill in the blanks as needed.

Maybe it saves the script locally (invisible to the user) and reuses it if the user repeats the same request, the script is deleted if it's not needed for X amount of time.


I don't see mention of this in the discussion, so I will add: I think people also don't close tabs. And probably these LI tabs have been up for a long time. Maybe weeks or months.

I completely exit my web browser(s) at least 1x per day, and use bookmarks to get back to pages I need. As a result, I don't have issues with memory leaks or unbounded growth of RAM use. For me, its just the "proper" way to use a program like a web browser, but I'm old enough to be from the era that restarting programs and the OS could fix issues. I recognize that most people feel it is unreasonable to quit the browser, pretty much ever.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: