This is still pointless though. I mean it's valuable from a learning perspective but the parent is saying they want to contribute somehow. You can only learn so much from toy examples
Once you learn how an LLM works, you can likely _begin_ to contribute meaningfully to numerous open-source AI projects: inference engines, training frameworks, etc. Or try to find an area of AI that is lacking research and start your own experiments. Or (potentially) go to work for a company doing similar or adjacent work.
Opportunity knocks, but you have to build the door first.
The prereqs aren't as extensive as people fear, but they are important. Starting out by building a scratch-trained GPT3-scale model is always an option, but anyone who's going to succeed at that doesn't need to watch any YouTube videos.
For the rest of us, the sense of discovery that we get from training and running toy models is a big part of the reward. This stuff is not an exact science, at least not yet, so time spent building intuition with small-scale models is an incredibly important part of the learning process. Not pointless at all.
I've tried to do this but with learning poker, and it's sort of a mixed bag. You kind of have to know what you don't know before you can get anything useful out of it. It can sort of help going from "I understand this concept, but not instinctively" to "I've drilled this enough that I could do things like this in my sleep", but it takes a lot of iteration and asking questions before it can settle on a series of instructive examples that each build on top of each other. You're still much better off with a well-written textbook.
I think it makes sense that the largest practitioner and beneficiary of a bad thing takes the brunt of the blame. No one can go around memorizing every factory that does bad stuff and which products originate from them.
Unless AI companies are willing to take on liability for bad decisions the bot makes some human who can be promoted or fired will need to roughly understand risks and tradeoffs of what ai does
> or that crops in the rest of the world are particularly resistant to mechanization
The causality is somewhat mixed up here. People in the US don’t, for the most part, grow rice because it doesn’t pay a competitive wage in the US. So parts of the world with lower wages end up growing most of the rice.
reply