There are two ways to end up with a similar artwork:
1. Create enough art in the same restricted domain, and some works will happen to look similar to others.
2. Use aspects of a work in the process of creating another. Without enough process, the result will resemble the original.
LLMs pretend to do #1: They first model a collection of works - called the training corpus - to implicitly generate a domain. Everything that is "hallucinated" by that model is restricted to that domain.
The entire goal of an LLM is to resemble the training corpus. The only interesting part is "in what way" that resemblance appears.
For example, an infamous paper illustrated that after being trained against valid Othello games (written as sequential piece positions), GPT can hallucinate a valid Othello game move. Does this mean that the game moves are novel art? Of course not! They are the result of the training corpus being modeled through a transformer. This is method #2 masquerading as method #1.
1. Create enough art in the same restricted domain, and some works will happen to look similar to others.
2. Use aspects of a work in the process of creating another. Without enough process, the result will resemble the original.
LLMs pretend to do #1: They first model a collection of works - called the training corpus - to implicitly generate a domain. Everything that is "hallucinated" by that model is restricted to that domain.
The entire goal of an LLM is to resemble the training corpus. The only interesting part is "in what way" that resemblance appears.
For example, an infamous paper illustrated that after being trained against valid Othello games (written as sequential piece positions), GPT can hallucinate a valid Othello game move. Does this mean that the game moves are novel art? Of course not! They are the result of the training corpus being modeled through a transformer. This is method #2 masquerading as method #1.