I asked it a solution to a problem using Flask and it gave me a partially working and an incredibly naive solution. I went to Google and found a few naive solutions each with discussions about why they will not work in certain cases. I spotted a blog by a trusted expert, and found the answer I wanted. GPT was convinced, however, that is naive solution was fine.
Stack Overflow is an amazing tool to find solutions to problems that worked 5 to 10 years ago, while newer versions of those questions get closed for being duplicates.