It can be surprisingly helpful. I needed a small program to change between three "states", two separate programs that use the gpu and can't run at the same time that I run on a server, and an "idle" state where none of them are running. And a simple web ui to check and change state.

This was the conversation: https://chat.openai.com/share/661322bc-2bd2-4608-9c7f-ec6d9f488601

Note that it did mess up the transitions code a bit, but it was easy to fix after a brief look at the documentation. However, the http page worked 100% straight off the bat, and the flask code and running of the commands worked perfectly. It's not a big thing, but a lot of "boilerplate" code and double checking docs was avoided. And this is the free tier.

I feed it the relevant documentation first. It has large enough context size to handle it. But even that's unnecessary as long as you're not using a niche library.