The study said 86.66% of the generated software systems were “executed flawlessly.”
But…
Nevertheless, the study isn’t perfect: Researchers identified limitations, such as errors and biases in the language models, that could cause issues in the creation of software. Still, the researchers said the findings “may potentially help junior programmers or engineers in the real world” down the line.
Ah, there’s the dream they’re chasing. Chatbots write the code for free, and junior devs play janitor to the robots and fix it up. No more expensive senior devs! The savings can be used as an executive bonus.
🎵🎵 99 little bugs in the code, 99 bugs in the code, Fix one bug, compile it again, 101 little bugs in the code. 101 little bugs in the code, 101 bugs in the code, Fix one bug, compile it again, 103 little bugs in the code. 🎵🎵
But…
So… they failed 13.34% of their own unit tests?
That’s a B+! Fire all our engineers immediately.
Better than CyberPunk at release.
Ah, there’s the dream they’re chasing. Chatbots write the code for free, and junior devs play janitor to the robots and fix it up. No more expensive senior devs! The savings can be used as an executive bonus.
And when the reviews are terrible and end users start reporting unreal quantities of bugs, they’ll fire the junior devs. They should have fixed those!
🎵🎵 99 little bugs in the code, 99 bugs in the code, Fix one bug, compile it again, 101 little bugs in the code. 101 little bugs in the code, 101 bugs in the code, Fix one bug, compile it again, 103 little bugs in the code. 🎵🎵