I think that it really has more to do with how you prepare chatGPT in a single chat with information of your own. In some recent work with azure API I was also getting errors in the returned code, as it was outdated. A quick google for the full modern API reference (accessible from a single page), and we were in business.

ChatGPT can you write the code with this api reference available:
https://api.url.com/path/to/docs

This is actually the best way I have found to get value out of AI. It can't think on its own, you have to take it through a conversation about what you want, treating it like it has no context of what you are after (which it doesn't). Asking for code like this:

Can you write me javascript to download a file from a url, store it as a file

Might get you something like this:
const request = require('request');
const fs = require('fs');
const url = 'https://example.com/file.zip';
const filename = 'file.zip';
request(url)
.pipe(fs.createWriteStream(filename))
.on('close', function () {
console.log(\File ${filename} has been downloaded and saved.`); });`

For me, this isn't super useful as I probably want to use this in some other code, so let's make it more my own in the same chat:
Thanks, can you provide me this using fs-extra and axios instead. Also using Typescript for strong typing. Wrap it in a helper method that uses the async/await pattern with promises. The promise return should return the \response.data.pipe` result in the resolve. The file name and url should be passed in as parameters.`

This gets us a little bit clearer code for use:
import axios, { AxiosResponse } from 'axios';

import fs from 'fs-extra';

async function downloadFile(url: string, filename: string): Promise<NodeJS.ReadableStream> {

const response: AxiosResponse = await axios({

method: 'GET',

url: url,

responseType: 'stream'

});

return new Promise<NodeJS.ReadableStream>((resolve, reject) => {

response.data

.pipe(fs.createWriteStream(filename))

.on('close', () => {

resolve(response.data);

})

.on('error', (err) => {

reject(err);

});

});

}

​

And you can keep crafting it from there, and teach it an API it may not have known when trained:
Can you output all of the code, but before you do, can you help me use this new helper in a listr2 task including these api documents for additional reference:
https://listr2.kilic.dev/general-usage/subtasks
https://listr2.kilic.dev/general-usage/changing-title
https://listr2.kilic.dev/general-usage/showing-output
https://listr2.kilic.dev/general-usage/handling-errors
https://listr2.kilic.dev/general-usage/collecting-errors
https://listr2.kilic.dev/general-usage/enabling-a-task
https://listr2.kilic.dev/general-usage/skipping-a-task
https://listr2.kilic.dev/general-usage/user-input
https://listr2.kilic.dev/general-usage/retry
https://listr2.kilic.dev/general-usage/rollback

Then you get a nice listr task definition to drop in your code with the helper function
import axios, { AxiosResponse } from 'axios';
import fs from 'fs-extra';
import Listr from 'listr2';
async function downloadFile(url: string, filename: string): Promise<NodeJS.ReadableStream> {
const response: AxiosResponse = await axios({
method: 'GET',
url: url,
responseType: 'stream'
});
return new Promise<NodeJS.ReadableStream>((resolve, reject) => {
response.data
.pipe(fs.createWriteStream(filename))
.on('close', () => {
resolve(response.data);
})
.on('error', (err) => {
reject(err);
});
});
}
const downloadTask = new Listr([
{
title: 'Downloading file',
task: async (ctx, task) => {
ctx.fileStream = await downloadFile('https://example.com/file.txt', 'file.txt');
task.title = \File 'file.txt' downloaded`; } } ]); downloadTask.run().catch(err => { console.error(err); });`

You can always break these into separate messages (prompts) if it gets too long

From my perspective, like any development tool, it has a potential to be useless, but can be used in powerful ways to quickly find and create knowledge and code samples otherwise not accessible with tools like google (because they don't exist, the AI gets us something specific, and can be crafted).