>It's much simpler, proprietary writing is now integrated into the source code of OpenAI
The source code of the LLM is likely a few hundred lines of text describing the shape of the neural networks involved in the model.
None of the NYTimes content will be in the source code. NYTimes doesn't publish Python source code, it publishes human language news.
LLMs are conceptually simple, mostly matrix multiplications and some non-linear operations connecting each layer, in some loops based on attention, etc. It's the staggering amount of training data and compute that makes them complex.
The source code of the LLM is likely a few hundred lines of text describing the shape of the neural networks involved in the model.
None of the NYTimes content will be in the source code. NYTimes doesn't publish Python source code, it publishes human language news.
LLMs are conceptually simple, mostly matrix multiplications and some non-linear operations connecting each layer, in some loops based on attention, etc. It's the staggering amount of training data and compute that makes them complex.