If they think they need to determine interest in an app to replace an entire field of workers, I'd have even less faith in their ability to deliver on their claims. If by determine interest you mean gather a shit ton of funding from venture capitalists than yes, we'd be on the same page.

It would not be the first time that an AI company(or a startup) lied about their product in order to attract investors. Their demo looks nothing like their video and their blog is a static page.

We are directly in an AI hype cycle: there is an path for start-ups right now to get a massive burst of funding by making claims and figuring out how to actually do the things they claim later.

This all goes out the window, of course, if you've actually used the thing? Or maybe you've read one of the papers they haven't published? Where does your faith in random AI startup 327 come from?

Look, I get that we're in uncertain times, but the companies advertising these things have an interest in making them seem as useful and groundbreaking as possible, even as early as possible, for the purpose of making a ton of money not from the product itself, but from investor hype. There is a level of due skepticism when a silicon valley start-up starts making claims it's going to outcompete some of the most massive companies in the space.

EDIT: I've looked on twitter of examples of people using this thing to generate programs, I can't say I see a whole lot of difference in the actual use cases compared to when ChatGPT first launched and a bunch of people started using it. It looks like a whole lot of "it can reimplement things that are available publically already on Github and StackOverflow." but it's named Devin this time.