If you want agency you have to put the AI into an environment and give it the means to perceive and act on the environment. The agent needs to have a goal and reward signals to learn from. Humans come with all these - the environment, the body and the rewards - based on evolution. But AIs can too - https://wenlong.page/language-planner/