The Human-in-the-Loop Is Tired

(pydantic.dev)

58 points | by haritha1313 3 hours ago

13 comments

  • appplication 33 minutes ago
    > Here's a term for what I think is happening: the human reward function problem. In machine learning, a reward function tells an agent what good looks like. Writing code by hand was never easy, but it was full of small rewards. Solving a problem in your head. Understanding a gnarly bit of logic. Watching the code compile. The feeling of control. LLM-assisted programming has automated much of the work that generated those dopamine hits and replaced it with the cognitive load of review and supervision. The satisfying part shrank. The exhausting part grew. And there are no new rewards to fill the gap.

    Say what you will about the Claudisms in this piece, this bit certainly rings true for me. With old school coding, there was always a reward at the end, the harder it was, the more satisfying it felt.

    With agentic coding, I really doesn’t feel like that, at least not in the same way. It feels more like continually riding a wave of productivity, where small features or huge features have similar levels of interaction required. And that’s exciting in the beginning but quickly becomes very tiring.

  • Terr_ 3 minutes ago
    [delayed]
  • N_Lens 1 hour ago
    While I appreciate and agree with the key points of the post, Claude's writing style fingerprints are all over it and I guess it's even more exhausting to read someone's AI written article.
    • hahahaa 1 hour ago
      I don't think it is AI, but I bet it has been through editing/review to match a corporate style. LLMs were trained on this.
      • ameliaquining 8 minutes ago
      • anon373839 47 minutes ago
        The writing style, if not AI, is at least a bit tryhard.

        Turning to the substance of the article: why do people feel the need to run this fast? I have certainly experimented with letting coding agents run amok. The first few times you try it, it feels like a superpower. Then you start examining the icky choices they made in a codebase that is now a dense forest. Then you have to expend a bunch of effort beating it back into submission. Or I guess you can YOLO and throw more AI at it, but then I agree with the person quoted saying "at that point, what am I still doing here?" This is not a satisfying or sustainable way to build, and there really is no reason other than hype and FOMO to do it.

    • parl_match 1 hour ago
      "If you can't be bothered to write it, I can't be bothered to read it."
    • postsantum 1 hour ago
      "It's not" - 3 matches

      Dashline - present

      Yes, it's AI-written

      • samplatt 1 hour ago
        "It's not" only has two matches; the third is "It's noticable". The other two are a whole paragraph dedicated to "it's not X, it's Y" which is a little more than you'd normally expect.

        Firefox doesn't seem to discriminate between em-dashes and hyphens using ctrl-F so I'm not sure about those.

        Having said that the tone REEKS of AI generation, so meh.

    • maxcoder3344 1 hour ago
      The most exhausting thing is listening to everyone complain about ai writing. It's the norm now and it isn't going away.
      • happytoexplain 1 hour ago
        I have such a hard time believing the implied premise of these complaints-about-complaints.

        Just say you don't mind AI writing - make that argument. Don't make this nonsensical, defeatist, "if it's common, stop criticizing it" argument.

        • singingtoday 59 minutes ago
          Well put. This kind of rebuttal, the "I'm not A, you're A", is not only tired, it's a strait up school yard fallacy.
        • maxcoder3344 48 minutes ago
          I mean fine contine to whine and not read articles that used AI. Enjoy reading nothing ever again and constantly making the comment "omg ai".
          • _fs 44 minutes ago
            You created a new account for this?
            • maxcoder3344 37 minutes ago
              No. I created an account for this. Hacker news used to be a place I could come read interesting content and peoples reactions and thoughts to it. now it's interesting articles with 100% of the comments whining that it's written by AI. Sad what hackernews has become
      • singingtoday 1 hour ago
        If complaining is exhausting to you, then I recommend avoiding Internet comments.
        • maxcoder3344 46 minutes ago
          Nah just whining about AI. At least it has given the hoards of uninteresting people something to comment on every single hackernews article now
      • bgun 59 minutes ago
        Complaints about complainers are even more exhausting.
  • zem 1 hour ago
    unlike the op, I've been having a wonderful time using claude, both at work and for my own personal projects, so I will share what has worked for me, just in case it resonates with anyone else.

    my anecdotal advice is to avoid the entire "agent" temptation, and treat the LLM as a code generator. have a single session running at a time. come up with a plan, iterate on it until you are satisfied, then tell it to execute the plan, and watch it. not necessarily to the extent of reading the scroll (though I sometimes do do that too!) but as it finishes each step look over what it has done, suggest improvements and course corrections, and then let it go on to the next step. at the end you will have a pretty good grasp of the state of the code, and the overall time it will take you isn't really any longer than trying to churn out reams of code and then go through it all at once.

    the other option if you want something closer to a one shot workflow is to go into far more detail during the planning stage, have it describe not just architectural details but actual code (if you're a senior engineer especially you probably know what the key pieces of code that will drive a lot of other decisions mechanically are likely to be).

    also refactoring is cheaper than it has ever been, if something feels hard to grasp to you stop and work with the LLM until you like the looks of it better.

    and again, the key bit is to have one LLM doing one thing at a time, and to stay engaged in the process while it does so.

    • 1473-bytes 32 minutes ago
      Agree with this. I have learned to interact with Claude the same way. Detailed hashing it out at the beginning, then finally execute, even maybe with your scaffolding at the beginning to guide the process. I tried writing this process down in a 'zen of Claude' as a reminder https://github.com/ctomkow/claude/blob/main/README.md I've started being able refactor legacy code into a new architecture with great success. Work I've been putting off due to the grind of the work.

      Edit: I will say it's taken me some months of working with Claude to get to this working process. If you let claude operate with free reign, the inevitable mess and struggle it runs into burns and stresses you out. Also, keeping up with some manual coding when you feel like it and punting to Claude when you have had enough manual coding ensures you still feel in control of the codebase.

    • hahahaa 1 hour ago
      I agree I think Vibe coding (even with myraid loops) is more burnouty than using it like an assistant and being closer to the output.
  • akeck 51 minutes ago
    Reminds me of "The Animal is Tired" (2021) (https://www.robinhobb.com/blog/archives/2021-05)
    • Avicebron 24 minutes ago
      This is a great read, thanks.
  • verdverm 1 minute ago
    Should we not get to work less if Ai is increasing productivity so much while also making us exhausted more quickly?

    Perhaps on the way to UBI and the end of labor, we could get a 32 and 24h work wweek with lots more vacation, my hope at least

  • recursivedoubts 1 hour ago
    You are right to push back on that.
  • TonyAlicea10 1 hour ago
    Funny I made some very similar points awhile back in a blog post, thinking of it in terms of mode collapse: https://tonyalicea.dev/blog/single-mode-burnout/
  • applfanboysbgon 1 hour ago
    > The honest truth

    > That loss is real and it's worth naming

    I think I will not heed the first sentence and bear with this. What motivates people to do this? What do they get out of prompting Claude for some vapid "thought piece" and spamming it on the internet?

    • greyface- 1 hour ago
      Clicks, views, attention. This blog is part of Pydantic's sales funnel.
    • jongjong 1 hour ago
      > That loss is real and it's worth naming

      Yep classic Claude-ism.

      The fact that this article was likely AI generated is the real load-bearing factor in this discussion. Or, as previous versions of Claude would say; it cuts through the heart of the issue.

    • singingtoday 50 minutes ago
      It got a lot of clicks here. Clicks equal money.
    • hyperhello 1 hour ago
      It's just as easy to do the second one as the first one.
  • thrymenarenot 48 minutes ago
    It stresses me out for some reason and I'm just working on a hobby project.
  • otter-in-a-suit 1 hour ago
    Relatable.

    > with my colleague Douwe

    Wait, meltano Douwe? Small world. Glad to see you're doing well. I always liked meltano.

    > In an era when anyone can produce reasonable-looking UI

    Identical looking slop? Every Claude-based vibe coded app looks identical.

    > The fear of skill rot is legitimate. And the fear that if you don't go fast enough you'll be left behind is — while often overstated — not entirely unfounded.

    You know what, that's OK. I just hit "OK" on LLM Scala code I _actually_ think is awful. It works. It's probably faster than the "pure" code I'd write by hand. The code I would write - as a FP and Scala/Elm/Haskell/... enjoyer - would actually be maintainable for humans, but LLMs struggle with it. But LLMs writing code for LLMs? Sure, have at it. Objectively lower barrier of entry.

    > So if you're feeling overwhelmed, destabilized, simultaneously more productive and less happy, know that you're not alone.

    But yes, I am indeed simultaneously more productive and less happy.

    https://skaldmaps.com, my little side project, was only possible _because_ I was able to feed my real world knowledge about real estate, combined with GIS and SWE knowledge into various torment nexus... pardon me, LLM prompts.

    Since I don't have the _time_ to write boilerplate react code (it's pepper and tomato season in Georgia, which _actually_ brings me joy), telling Claude/Codex/... how to write dbt models saves me time and I objectively get a lot more done, but it's not fun.

    I guess that's also why I still enjoy blogging. You can't use LLMs for blogs without people noticing immediately. Shameless plug: https://chollinger.com/blog/

    Enjoy my entirely human typos, since that's clearly rare these days.

  • UnfitFootprint 1 hour ago
    [dead]
  • lardosaurusrex 1 hour ago
    "omg im so totally tired of ai u guiz lmao" proceeds to post claudeslop.
    • kaashif 6 minutes ago
      Indeed. I guess we're talking about it, which is the point of marketing blog posts like this.

      If it weren't claudeslop, it would still have to be marketing corposlop.

    • fizzbuzzdizz 1 hour ago
      [dead]