> It is kind of amazing that these models manage to figure out a strategy at all, considering the game is not in their training set.
I'm not sure we can conclude the game's not in their training set - a lot has been written about Factorio on the internet, and a lot has been recorded; the newer multimodal LLMs have trained on YouTube, especially Gemini.
The models have some understanding of the game and the initial build orders that they should adopt. What they don't remember is:
1) How many resources each item costs to make
2) Spatial gotchas such as a belt requiring an inserter to load/offload from.
I'm not sure we can conclude the game's not in their training set - a lot has been written about Factorio on the internet, and a lot has been recorded; the newer multimodal LLMs have trained on YouTube, especially Gemini.