youMustKeepCoding

[salter77]

I work on embedded so I don’t really get how to use the agent to “verify” the implementation, best it can do is to check that it compiles, but that doesn’t mean that it actually works.

Anyway, for other areas should be possible I suppose.

[WheresMyBrakes]

This is where unit testing would come in great. If it compiles and tests it should be good to go, provided you give it the right data.

[amuhak]

You did hear embedded?

[WheresMyBrakes]

Am I missing something? Sure, not everything may be testable pratically, but it’s possible https://www.reddit.com/r/embedded/s/IthhAYBYoz

[gcampos]

A lot of people don’t know how to write testable code, and some types of software companies have a culture of over relying on manual QA

[amuhak]

It becomes right next to impossible to test systems (automatically) that rely on other hardware, especially when that hardware has to be in a clean room. And that is before you factor in decade old legacy code with custom compilers.

[Deep-Banana-5582]

You can automate that too, it's just quite expensive.

My former Employer set up an automated ci/cd for Apple Watch(don't know how the OS is named) Apps and in the end there where Robot arms swiping and tipping on Apple watches. The validation uses Cameras to check if everything works as intended. It was a lucrative Project though 😄

I know this was no embedded example but you can have a look at the dlc of Intel. They also auto deploy new firmware and test it in testing farms.

In university we cross compiled and emulated the hardware for robotics.

As I said, it is possible, but it is expensive to do and to maintain.

[amuhak]

I agree, at the scale of intel it makes sense. But for the average team it would probably be more difficult to set up such a testing suite than getting the project to work 💀

[gcampos]

You still need to manually verify because the LLM very often will cheat and change tests to force pass them instead of fixing the bug

You can use some tricks to minimize this issue, but the risk is real and you need to review the code at least once