With luck, SWE culture will change towards caring about large-scale rearchitecture (and reward those who care enough to refactor and polish, polish, polish.)
Or perhaps in a more "enlighted society" you get taken to the benchmark/post-training material writing gulag, and suffer the indignities of having to teach AI how not to make your mistakes. Confess your sins to GPT-225 Galaxias for the honor of RAM Altman!
> The combination of all these elements going into the future means that if Apple wants to stay ahead, I believe Apple has no choice but to take memory in house, they have the design and engineering capability in-house, and they have the money because they didn’t burn it on AI models and data centers.
I wouldn't be surprised if that was happening already -- they plan five years ahead, after all, and they've been slowly taking other systems in-house (e.g. baseband/modem) already.
> Put simply: the inference pie may become so large that both client and datacenter win.
Beyond inference, even local HPC or large in-memory workloads. Steve Jobs dreamed that the NeXT Computer could be used to cure cancer in a dorm room (whatever tha tmeans), and I guess a bunch of Mac Studios chained together wouldn't be bad for a lot of computationally tough biomedical "basic science" applications.
It's fun to think about Claris as the hobby "well, we'll see if it works out I guess, but no worries if not" brand. Perhaps "Claris Vision Pro" would have been less embarrassing for Apple. Hell, if they want to bring their car project back, "Clarismobile" would be hilarious.
reply