• @Not_mikey@lemmy.dbzer0.com
    link
    fedilink
    English
    0•5 hours ago

    What makes you think he wouldn’t have made the same mistake hand coding it?

    If he didn’t catch it on his own review the likelihood that he would’ve made the same mistake if he coded it himself is high.

    • keisatsu
      link
      fedilink
      English
      3•
      edit-2
      4 hours ago

      First of all, if a human makes a mistake it’s a learning opportunity. When a human misses a bug an LLM hallucinated, noone really learn from it.

      I like to compare it with the xray machines at airports. Human operators stare at the screens hunting for weapons and other prohibited items and miss pretty obvious stuff because they get bored out of their minds. They actually added a mechanism to insert fake xray images of weapons ever so often to actually keep the operators interested and alert. Ain’t much too different from doing code reviews being the human-in-the-loop/scapegoat.

      Also, LLMs don’t necessarily generate good code. They excel at generating good-looking mediocre code.

      So yeah, I’m gonna go ahead and claim that Linus is more likely to miss a bug a LLM wrote on his behalf than one he wrote himself.

      • @Not_mikey@lemmy.dbzer0.com
        link
        fedilink
        English
        0•
        edit-2
        36 minutes ago

        First of all, if a human makes a mistake it’s a learning opportunity. When a human misses a bug an LLM hallucinated, noone really learn from it.

        Agents can “learn” from their mistakes within their harness.

        You or the agent can add notes in the memory files or the repo level agents.md files, or standards and conventions files to look for those mistakes.

        Most harnesses these days will spin up a new agent to do a review once the implementation is done, that agent will take memory files, agents.md files and other standards and conventions files into its context to know what to look out for so it won’t make the same mistake twice

        Claude code is even doing “dreaming” where it’ll do a cron every night to look through all the conversations from the day for stuff it messed up on and add to its memory files to not do those same mistakes.