1. improving their adtech. someone else's API offerings are not an option due to the sheer volume, PII and whatnot.
2. virtually free moderation for their existing (facebook, instagram, threads) and future social media services. likewise, their volume is too insane to even consider paying someone else to process it.
the models they do release are probably toys in comparison to their internal models.
> the models they do release are probably toys in comparison to their internal models.
I'm not sure if that's true. They did say they're going to make Llama 3 400B public and if they follow through, that's no toy and I doubt they have something significantly better internally.
LLMs aren't a monetizable product themselves. For the foreseeable future, that will always be ads. LLMs (and VR) are just big bets on getting ahead of future technology.
I still believe that a VR future is coming once the technology commoditises i.e. costs come down 10x and we have 3090 level GPUs in the headset. At that point we will have photo-realistic experiences like concerts etc that anyone can afford.
And at that point having a lot of LLM based avatars that can help "fill in the space" will be valuable.
