My experience in trying to get them to play text adventures[1] is similar. I had to prompt with very specific leading questions to give them a decent chance of even recognising the main objective after the first few steps.

[1]: https://entropicthoughts.com/getting-an-llm-to-play-text-adv...