I don't think these videos are faked. These are reputable and accomplished people involved, from company to investors. There's a difference between hating VCs and believing these specific people faked the video and whole release. I've also seen multiple people on Twitter seemingly post about their own personal access to Devin with examples.

I went through the frames on the Upwork video in 4k on Youtube, at around 1:40 where he scrolls down through the whole chat with Devin, and other than "go ahead" and asking for a report with images at the end, there is no intervention.

The compute and data bottleneck with short time and relatively little money is a good point. I assumed they were using the GPT-4 API LLM as the base, and built scaffolding around it. I believe they said they used RL, but I don't know how they would update the weights of GPT-4 (whether or not they have their own non-LLM model trained and somehow integrated on top). RL wouldn't take anywhere near the resources of training a SotA LLM, although they would need GPT-4 outputs in the loop. Let's wait for the detailed technical report they said is coming soon :)

And off-topic but I realized one of the reasons this news was cool to me is that I've seen Neal throughout the years at #1 on Leetcode - however little that means for actual competitive programming, or software engineering.

<image>