We could have eradicated hunger and extreme poverty worldwide with a fraction of the money that is being spent on the AI boom, it's not a technology problem. I don't see why we would need a superintelligence to solve these problems, while it's not hard to imagine different ways in which a superintelligence could harm humanity.
This is a very good question. In some ways it's not. But it's just a quirk of fate that physical skill was automated first, and after that, we at least had the mental domain to retreat into and be unique and useful. And in doing so, we molded our society to fit this paradigm. With both the mental and the physical domain taken now, there is no further domain to go into to feel a purpose.
Probably something similar would happen if only the mental domain were automated first: our society might become one where physical skill is where we found our purpose.
Finally, let's also keep in mind that much of physical skill has NOT been automated. People use their hands all the time (car mechanics, plumbers, builders of houses, etc.)
Until the LLM is able to figure out exactly how your brain works and able to satisfy all your creative needs exactly. Why do people keep thinking that human is somehow a meat with some special sauce? We have a brain, its made up of neurons, we (or the AI) can fully figure us out. Just like we figured out how to satisfy the dog, so too can the AI.
> But it's just a quirk of fate that physical skill was automated first
Huh? It’s the other way round. We’re pretty much at the point where we’ve automated Fields medalists. Meanwhile, we’re nowhere close to automating plumbers. Like, not even remotely close.
I'm not going to stake out a position on how close we are to automating either job, but lots of plumbing tasks are being automated all the time, same as math tasks. I overheard recently some workers talking about how there are now drones you can send into a pipe to clear a clog. Automating a plumber? I don't know, but it's definitely automated plumbing as much as this is automated theorem proving.
Generally speaking I think people overestimate the degree to which AI is automating away knowledge work, while underestimating the degree to which it's automating everything else. That's not to say either side of the equation has been replaced by machines.
Prior to computerization basically only physical skills were automated. Physical automation came first, hundreds of years ago. Mental automation is very, very new.
1 human physical effort? Maximum, 1 human effort. 1 human mental effort, say writing a textbook, which can then be copied much cheaper than trying to copy 1 entire human.
Why are some pretending that mental capacity (intelligence) isn't what separates us from other animals? Why are some pretending that fields like philosophy don't exist and that reasoning about the human condition, the universe, and our place within it isn't uniquely human and necessary? Why are some pretending that thinking itself is not a fulfilling endeavor or that it doesn't guide people down fulfilling paths?
Why are some pretending that physical effort and skill isn't itself a function of thinking? And, why are we injecting the relative importance of physical effort, when the lament is of human intelligence possibly becoming irrelevant?
I'm trying to understand this view. What is it about the state of biological humans in 2026 that makes this moment in time worth attempting to halt evolution for?
How do you know that the state of AI in 5026 won't be a far more joyous one?
I understand that, and I love humans as much as anyone. But we didn't seriously think we were the last stop on the evolution train, did we? Our capacity to gracefully yield in the face of whatever is emerging is one of our best qualities; let's utilize that.
I'm not sure I fully understand what you're trying to say. Are you suggesting that AI is the next evolutionary step beyond humanity, and therefore humanity should just accept that and gracefully fade away?
1. The world has been constantly getting worse with advanced telecommunications technologies. Social media, internet, etc, global warming. There's much more evidence that what we're doing is a downward spiral.
2. Most people want a purpose. It's highly unlikely that a world in which machines can do everything better is a good one. It's intuitive.
Point 1 is extremely debatable. Our current time has new problems that we're still learning to contend with for sure, but for the rest of human history life has been best summarized as most often being painful, violent, and short. Nowadays violence continues to trend downwards and happiness upwards even though things could still very much be better.
Point 2 is again going to vary a lot from person to person. There are people out there today who would prefer to never retire, going back into minimum wage customer service jobs in their elder age just because they want to, and I'd wager they would agree with you. On the other hand, there are swathes of people who can't wait to be free of responsibility, and countless more that are crushed by poverty and hunger when they can't meet it. Those people certainly care much less about "purpose," or in many cases are certain they won't find purpose in something as mundane as a job.
Yes it’s been trending downwards for decades. Like, a lot.
The world is much, much safer than the 70s, 80s, or 90s. It doesn’t seem that way because everyone is trying to convince you it’s not. But statistics don’t lie. This is the best time ever to not die or get robbed.
One set of arguments I found compelling is “The Better Angels of our Nature” by Steven Pinker, although I'll admit I've only watched his talks on YouTube on the matter and not read the book.
For point 2, I don't think a world where machines can do everything better necessarily results in a widespread lack of purpose.
For some, it's easy to forget: being at the cutting edge, being the best, doing things that have never been done, solving problems that no one else could are _not_ the only sources of purpose in life.
For example: chess is more popular now than it's ever been. People don't really seem all that bothered by the fact that they are absolutely outmatched by the machines. They do it anyway, and seem to get some sort of joy or purpose out of it.
(That being said, I can't say I'm all that happy about the way things are headed.)
This seems extremely disingenuous, change is famously difficult to deal with and AI has called people’s entire careers and life plans into question. It has made it nearly impossible to have any kind of expectation for what your future will look like. This is scary.
It looks like a mass phobia to me. It goes beyond healthy concern to something irrational. Yes it's scary, yes there are risk, but there is a massive negative outlook bias in American culture due to an industry that profits from attention, since the best way to get people's attention is to freak them out.
> change is famously difficult to deal with and AI has called people’s entire careers and life plans into question.
Of course, nobody wants to be unsympathetic to the pains of change; we all feel it. But this "life plans into question" line of reasoning strikes me as perhaps the pinnacle first-world-problem.
What is so special about today's world order, where the distribution of goods is tenuously connected to "jobs", but even more so, to predation and warfare, that we want to cling to it?
Clinging to "jobs" and "careers" as organizational modalities seems even more insensitive to changing times than accepting their deprecation.
People cannot be expected to accept the deprecation of the thing that feeds them and gives them a house without some alternative. Blaming this on social media is insensitive and rude.
The only people who I know who think there is no alternative are those who spend an unhealthy amount of time on social media.
> Blaming this on social media is insensitive and rude.
To who? The social media companies??
Social media is extremely addictive and is causing maybe the worst mental health crisis in human history. It's completely distorting people's perspectives and making them less capable of taking care of themselves and building a rewarding life. Every hour spent on social media isn't only an hour wasted, it's a degradation of ability to focus, of willingness to do hard things that are worth doing, a corruption of world view, and adoption of opinions that are unconstructive. Media is giving people an irrationally negative outlook of the future which has the potential to be very much a self fulfilling prophecy.
If this offends you then maybe you really need to be offended.
I actually don't know that to be true. I'm not entirely sure what I am. It seems increasingly plausible to me that I'm actually an AI living many thousands of years hence, and that my conscious experiences are actually the feeling of a query being run about today's world.
I know I feel great playing my guitar or mandolin. I like drugs and want to do more psychedelics next year. I want to get back to dating; my transition to a bluegrass career amidst software engineering jobs disappearing has been very consumptive, although very rewarding. I can probably name 2-3 other similar intentions that feel distinctly like those of a biological human.
But I don't presume that I fully understand what I am, what my consciousness is, etc. These are old questions worth pondering rather than presuming.
I do worry that AI will have trouble understanding the importance of sex, drugs, and rock 'n' roll.
I would say you are a flicker of electric charge running across a large blob of fat tissue held up by a sack of meat supported by a bunch of bones. No insult intended. But what do I know.
Of course facially this is how I appear to myself, at least while I'm awake.
But I'm not so steadfast in my certainty about what reality is to demand that the universe halt its operations because I think that blobs of fat tissue held up by a sack of meat supported by a bunch of bones are the perfect end state.
What happens after AGI? I guess widespread unemployment among white collar workers, social unrest, and possibly the first steps towards a dystopian techno-oligarchical society.
All of the goverments? What makes you think they would all agree with that? Make a list of which ones you think are least likely to agree with you. And then imagine what happens if they outcompete everyone else on AI.
An agreement is mainly needed between the US and China, as they are at the forefront of the race. It's challenging but it's in their best interest. Many other countries would likely see favorably such an agreement, also because they are far behind in the race (my guess is that this would be the case for the European Union, and possibly for several developing countries). Once the agreement is supported by at least the three most powerful economic blocs in the world, the few uncooperative countries left could be forced to comply through an unbearable economic pressure.
Yes of course we need. Software sucks. And sucks because there is a LOT of work to do. Always. Not only strictly programming work, right. But in fact LLMs can do also UI, UX and more.
We have a fantastic tool which is cheap and very fast. With good quality even if not great. This is a massive leap.
AI in software development should be limited to security scans and maybe occasional bug-fixing.
We'll have the best of all worlds: more secure code bases, happier & not unemployed developers, human understanding of what the code does, and far less money for companies that are hijacking our future by developing a god-like artificial super-intelligence.
Same for me. I have adopted a "zero usage" policy for the moment. In part it's because I am too worried about the long-term effects of cognitive offloading. In part it's because I don't want to support in any way the development of a technology that I believe is becoming a serious threat to humanity. And there are also things that I enjoy doing, like coding, solving problems, or writing in my own style, which I simply don't want to delegate to a machine.
reply