And in general, especially with something like C, the correspondence between the compiled code and source code isn’t very “lossy”. You don’t get one-to-one correspondence but it’s not too bad and you’re not introducing massive uncertainty by running it through a compiler. With LLMs though all bets are off… you’re not gonna know what you end up with
Precisely. I think everyone has been affected by the fearmongering and gaslighting to some dfgree. But step back and try and see whether software's getting better as a whole or going into reverse? OpenAI has basically unlimited internal compute and talent yet they screw this up amongst many other things. Shouldn't it be a 5 minute job for someone at AI to spin up a team of agents annd make sure this sort of thing never happens?
At a high level, most uses of AI I've seen seem to be people building other AI tools, orchestrators, managers, agent managers etc. But these are all means to ends. I mean I guess it's nice to play aroud with harnesses and command agents to do this and that, but where are the tangible outputs?
I just see so many people boasting of their token burn and the complexity of their agentic setup, yet they rarely show the actual outputs
I do. I deny the "gains". The "gains" will turn out to be a mirage in the medium to long term. The technical and cognitive debt incurred will be too extreme.
IMO there's a big difference between using AI to write code and using it to review your code. In the latter, you know the code well (you are the one who wrote it), and so it is much easier to understand if AI suggestions are good or hallucinations. In the former case, realizing when the AI is making mistakes is harder, because you don't have the full context anymore.
That's a fair challenge. AI review can mean many different things though. We treat it like a slightly better CppCheck, for context. TBH the way we use it doesn't really add much beyond regular static analysis tools.
Re "the hard way", I disagree. While it may seem like the hard way, in the medium and long term this is turning out to be the easy way. We have basically no technical debt, we can fix issues rapidly and (intangible I know) we can stand behind our codebase with absolute confidence.
reply