Technology

AI is an amplifier.

So very much this ^^^.

If you put in the same time and effort creating software using AI that you would have put in coding by hand, in my experience you get better software, much more thorough documentation and automated testing, and fewer "oops" moments down the line. Not perfection, but better.

If you just give a loosely specified prompt and take the first functional looking thing that comes out, you can get code 10x faster than ever before, and it's going to be a 100x bigger mess to maintain.

A rule of thumb (aka useless constant applied to imaginary metrics) that my colleagues and I have found is: 80%. Work on an assumption that what you get back from each AI pass is about 80% good or right. Work to identify the 20% that needs more refinement, do another pass, now you're up to 96% good - and honestly probably already better than most first pass ready for a pull request code we used to submit 2 years back. Do a third pass on that and you've probably got something that's not going to give any trouble in all but some really rare cases, and you got it in about half the time you would have spent on lower quality output.

I have been trying, with limited success, to get our junior engineers to use AI to review their own code before submitting pull requests. Some do a single pass and their PRs are pretty good, one says he "doesn't believe in AI" and his code typically needs 3-4 review passes before it's even acceptable, even though he's clearly using AI to write the documentation. AI review is how they're finding all these zero day exploits in widely used products, it works, it finds maybe 80% of things you're looking for (if you keep the scope focused inside its context window capacity.) We are having slightly more success with all the junior engineers by having them submit 5-10 small pull requests per 2 week sprint instead of one big one. This not only helps human reviewers understand the bite sized chunks, it also means the AI reviews are more thorough. It also means the architectural definition steps are much more critical because review of tiny chunks misses more of the architectural level picture.

The biggest ethical question I have about using AI centers on management of management expectations. If management really thinks the human contribution value in software creation has disappeared overnight - I'd look for different management, because that ship just steered straight into an iceberg field. Some of them may pull off the Kessel run in less than 12 parsecs, but most won't.