As someone who never asked a question in StackOverflow for what are probably similar reasons (despite being in this career for 20 years), I still find that ChatGPT in this regard is still more like a Google or an improved StackOverflow/documentation search…
It can infer some things, modify variable names to match mine, but for the real hairy stuff I still gotta do the legwork myself, normally by reaching out for the source code.
I did. For the kind of creative/exploratory stuff I’d normally go to the source code myself for, I find that even GPT-4 still hallucinates quite a bit. Even when it has the source code, it still makes up random functions and parameters. Even when the source code is minimal.
It will probably work better in the future, but so far it is a bit limited. Probably a memory limitation more than anything.
It can infer some things, modify variable names to match mine, but for the real hairy stuff I still gotta do the legwork myself, normally by reaching out for the source code.