Hacker Newsnew | past | comments | ask | show | jobs | submit | lf88's commentslogin

We could have eradicated hunger and extreme poverty worldwide with a fraction of the money that is being spent on the AI boom, it's not a technology problem. I don't see why we would need a superintelligence to solve these problems, while it's not hard to imagine different ways in which a superintelligence could harm humanity.

> I don't see why we would need a superintelligence to solve these problems,

Yes, we do need advanced and open AI now.

> while it's not hard to imagine different ways in which a superintelligence could harm humanity.

That's why.

P.S. A heartfelt request to not use the term spooperintelligence in the future, it upsets my stomach.


I suspect much more than you think. Most humans probably have some of those aspirations in some form.

This post resonates a lot with me. It's depressing to see so many people rooting for a future in which human intelligence becomes irrelevant.

Why is human mental effort more important than physical effort or skill?

This is a very good question. In some ways it's not. But it's just a quirk of fate that physical skill was automated first, and after that, we at least had the mental domain to retreat into and be unique and useful. And in doing so, we molded our society to fit this paradigm. With both the mental and the physical domain taken now, there is no further domain to go into to feel a purpose.

Probably something similar would happen if only the mental domain were automated first: our society might become one where physical skill is where we found our purpose.

Finally, let's also keep in mind that much of physical skill has NOT been automated. People use their hands all the time (car mechanics, plumbers, builders of houses, etc.)


This is incorrect. There is always the creative domain, and it isn't going anywhere because it's subjective.

Until the LLM is able to figure out exactly how your brain works and able to satisfy all your creative needs exactly. Why do people keep thinking that human is somehow a meat with some special sauce? We have a brain, its made up of neurons, we (or the AI) can fully figure us out. Just like we figured out how to satisfy the dog, so too can the AI.

> But it's just a quirk of fate that physical skill was automated first

Huh? It’s the other way round. We’re pretty much at the point where we’ve automated Fields medalists. Meanwhile, we’re nowhere close to automating plumbers. Like, not even remotely close.


I'm not going to stake out a position on how close we are to automating either job, but lots of plumbing tasks are being automated all the time, same as math tasks. I overheard recently some workers talking about how there are now drones you can send into a pipe to clear a clog. Automating a plumber? I don't know, but it's definitely automated plumbing as much as this is automated theorem proving.

Generally speaking I think people overestimate the degree to which AI is automating away knowledge work, while underestimating the degree to which it's automating everything else. That's not to say either side of the equation has been replaced by machines.


Prior to computerization basically only physical skills were automated. Physical automation came first, hundreds of years ago. Mental automation is very, very new.

Writing is automation of a mental skill (memory), and it’s 5000 years old.

Well, I was referring to the physical skills that have been automated. Besides, I already made that qualification in my original comment.

1 human physical effort? Maximum, 1 human effort. 1 human mental effort, say writing a textbook, which can then be copied much cheaper than trying to copy 1 entire human.

Human mental effort literally commmands armies.


Have I claimed that? Anyway, robotics may at some point make also any "physical effort or skill" irrelevant, which adds to the problem.

Because we excel at it. There is still no thing in the universe that comes close to us in intelligence, cunning or wits.

You can make a lever that lifts what a hundred men couldn't, but you can't make a machine that thinks and solves problems like a human can.


In the universe? Maybe nothing we've been smart enough to find.

Well, for one, applying mental effort helps us comprehend that the grand-parent comment didn't say it's more important than the other things?

Why are some pretending that mental capacity (intelligence) isn't what separates us from other animals? Why are some pretending that fields like philosophy don't exist and that reasoning about the human condition, the universe, and our place within it isn't uniquely human and necessary? Why are some pretending that thinking itself is not a fulfilling endeavor or that it doesn't guide people down fulfilling paths?

Why are some pretending that physical effort and skill isn't itself a function of thinking? And, why are we injecting the relative importance of physical effort, when the lament is of human intelligence possibly becoming irrelevant?


Because mental effort conquered the natural world, not physical effort or skill.

Now something else will conquer the world from us.


I'm trying to understand this view. What is it about the state of biological humans in 2026 that makes this moment in time worth attempting to halt evolution for?

How do you know that the state of AI in 5026 won't be a far more joyous one?


even if state of Ai in 5026 is more joyous, it says nothing about state of humans

I understand that, and I love humans as much as anyone. But we didn't seriously think we were the last stop on the evolution train, did we? Our capacity to gracefully yield in the face of whatever is emerging is one of our best qualities; let's utilize that.

I'm not sure I fully understand what you're trying to say. Are you suggesting that AI is the next evolutionary step beyond humanity, and therefore humanity should just accept that and gracefully fade away?

I'm not sure if this thing that we are currently calling AI is the next evolutionary step, but I'm sure there will be one.

There is such a thing as a species traitor. And to argue against all living lifeforms in favour of a machine? Utter blasphemy.

> Our capacity to gracefully yield in the face of whatever is emerging is one of our best qualities; let's utilize that.

Knock yourself out!


> I love humans as much as anyone.

That does not appear to be the case.


When have humans demonstrated this "capacity to gracefully yield in the face of whatever is emerging"?

1. The world has been constantly getting worse with advanced telecommunications technologies. Social media, internet, etc, global warming. There's much more evidence that what we're doing is a downward spiral.

2. Most people want a purpose. It's highly unlikely that a world in which machines can do everything better is a good one. It's intuitive.


Point 1 is extremely debatable. Our current time has new problems that we're still learning to contend with for sure, but for the rest of human history life has been best summarized as most often being painful, violent, and short. Nowadays violence continues to trend downwards and happiness upwards even though things could still very much be better.

Point 2 is again going to vary a lot from person to person. There are people out there today who would prefer to never retire, going back into minimum wage customer service jobs in their elder age just because they want to, and I'd wager they would agree with you. On the other hand, there are swathes of people who can't wait to be free of responsibility, and countless more that are crushed by poverty and hunger when they can't meet it. Those people certainly care much less about "purpose," or in many cases are certain they won't find purpose in something as mundane as a job.


> Point 1 is extremely debatable.

Definitely true! Which is why the future will be essentially dominated by new wars between people on the different sides of the debate.


> Nowadays violence continues to trend downwards ...

Say what?


Yes it’s been trending downwards for decades. Like, a lot.

The world is much, much safer than the 70s, 80s, or 90s. It doesn’t seem that way because everyone is trying to convince you it’s not. But statistics don’t lie. This is the best time ever to not die or get robbed.


One set of arguments I found compelling is “The Better Angels of our Nature” by Steven Pinker, although I'll admit I've only watched his talks on YouTube on the matter and not read the book.

For point 2, I don't think a world where machines can do everything better necessarily results in a widespread lack of purpose.

For some, it's easy to forget: being at the cutting edge, being the best, doing things that have never been done, solving problems that no one else could are _not_ the only sources of purpose in life.

For example: chess is more popular now than it's ever been. People don't really seem all that bothered by the fact that they are absolutely outmatched by the machines. They do it anyway, and seem to get some sort of joy or purpose out of it.

(That being said, I can't say I'm all that happy about the way things are headed.)


I don't think most people arrive at this world view through carefully considered reasoning. They arrive at it through social media addiction.

This seems extremely disingenuous, change is famously difficult to deal with and AI has called people’s entire careers and life plans into question. It has made it nearly impossible to have any kind of expectation for what your future will look like. This is scary.

It looks like a mass phobia to me. It goes beyond healthy concern to something irrational. Yes it's scary, yes there are risk, but there is a massive negative outlook bias in American culture due to an industry that profits from attention, since the best way to get people's attention is to freak them out.

> change is famously difficult to deal with and AI has called people’s entire careers and life plans into question.

Of course, nobody wants to be unsympathetic to the pains of change; we all feel it. But this "life plans into question" line of reasoning strikes me as perhaps the pinnacle first-world-problem.

What is so special about today's world order, where the distribution of goods is tenuously connected to "jobs", but even more so, to predation and warfare, that we want to cling to it?

Clinging to "jobs" and "careers" as organizational modalities seems even more insensitive to changing times than accepting their deprecation.


People cannot be expected to accept the deprecation of the thing that feeds them and gives them a house without some alternative. Blaming this on social media is insensitive and rude.

> without some alternative

The only people who I know who think there is no alternative are those who spend an unhealthy amount of time on social media.

> Blaming this on social media is insensitive and rude.

To who? The social media companies??

Social media is extremely addictive and is causing maybe the worst mental health crisis in human history. It's completely distorting people's perspectives and making them less capable of taking care of themselves and building a rewarding life. Every hour spent on social media isn't only an hour wasted, it's a degradation of ability to focus, of willingness to do hard things that are worth doing, a corruption of world view, and adoption of opinions that are unconstructive. Media is giving people an irrationally negative outlook of the future which has the potential to be very much a self fulfilling prophecy.

If this offends you then maybe you really need to be offended.


Well for one, we’re alive during this time. It’s obviously the most important time in human history because it’s my time. And yours, too.

Maybe things will be sick in 5026. I won’t be around to see it.


You are a biological human in 2026, why do you speak as if you no longer comprehend basic human nature?

I actually don't know that to be true. I'm not entirely sure what I am. It seems increasingly plausible to me that I'm actually an AI living many thousands of years hence, and that my conscious experiences are actually the feeling of a query being run about today's world.

I know I feel great playing my guitar or mandolin. I like drugs and want to do more psychedelics next year. I want to get back to dating; my transition to a bluegrass career amidst software engineering jobs disappearing has been very consumptive, although very rewarding. I can probably name 2-3 other similar intentions that feel distinctly like those of a biological human.

But I don't presume that I fully understand what I am, what my consciousness is, etc. These are old questions worth pondering rather than presuming.

I do worry that AI will have trouble understanding the importance of sex, drugs, and rock 'n' roll.


Welp. That's enough Hacker News for a while.

I would say you are a flicker of electric charge running across a large blob of fat tissue held up by a sack of meat supported by a bunch of bones. No insult intended. But what do I know.

Of course facially this is how I appear to myself, at least while I'm awake.

But I'm not so steadfast in my certainty about what reality is to demand that the universe halt its operations because I think that blobs of fat tissue held up by a sack of meat supported by a bunch of bones are the perfect end state.


woah! If this proof is correct it's likely much more valuable than a giant lean file!

What happens after AGI? I guess widespread unemployment among white collar workers, social unrest, and possibly the first steps towards a dystopian techno-oligarchical society.

Slowing down is not enough! Governments should immediately stop any further progress towards more capable artificial general intelligence.

All of the goverments? What makes you think they would all agree with that? Make a list of which ones you think are least likely to agree with you. And then imagine what happens if they outcompete everyone else on AI.

An agreement is mainly needed between the US and China, as they are at the forefront of the race. It's challenging but it's in their best interest. Many other countries would likely see favorably such an agreement, also because they are far behind in the race (my guess is that this would be the case for the European Union, and possibly for several developing countries). Once the agreement is supported by at least the three most powerful economic blocs in the world, the few uncooperative countries left could be forced to comply through an unbearable economic pressure.

prohibition never works, this would just be market leading countries giving up their spot

This is one of the reasons why I try to ignore the AI overview and go straight to the links below.

Full circle.

But do we really need to generate orders of magnitude more code per day than what people were writing a few years ago?

Yes of course we need. Software sucks. And sucks because there is a LOT of work to do. Always. Not only strictly programming work, right. But in fact LLMs can do also UI, UX and more. We have a fantastic tool which is cheap and very fast. With good quality even if not great. This is a massive leap.

AI in software development should be limited to security scans and maybe occasional bug-fixing. We'll have the best of all worlds: more secure code bases, happier & not unemployed developers, human understanding of what the code does, and far less money for companies that are hijacking our future by developing a god-like artificial super-intelligence.

Same for me. I have adopted a "zero usage" policy for the moment. In part it's because I am too worried about the long-term effects of cognitive offloading. In part it's because I don't want to support in any way the development of a technology that I believe is becoming a serious threat to humanity. And there are also things that I enjoy doing, like coding, solving problems, or writing in my own style, which I simply don't want to delegate to a machine.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: