It's not a simple setup. You have to use something like https://github.com/kim-space/dify2openai because dify doesn't implement the openai endpoints. There may well be better options out there now, I've been running this setup for a while.