How to Spot AI Writing

(economist.com)

25 points | by ijidak 1 hour ago

22 comments

  • kranner 40 minutes ago
    Surprised to find no mention of "load-bearing" and "gated" particularly for Claude.

    In particular Opus 5 is scaling new heights of incomprehensibility with excessive metaphor-making, especially when it uses an existing word in the prompt or the code comments as a novel metaphor in an unrelated context.

    • cowlby 33 minutes ago
      My Fable pet-peeve is "You're half right, and half wrong, and the wrong half is worth diving into"
      • jascha_eng 25 minutes ago
        But fables is often worth diving into at least. Opus 5 says this and then rambles on about something completely irrelevant or even wrong
    • derwiki 19 minutes ago
      “Reply with ASD-STE100” has been a God-send.
      • grvdrm 8 minutes ago
        Just tried this as part of an ask about chronic inflammation. What an enormous difference your tip makes in the reply style and structure - wow. And thank you.
    • ahartmetz 10 minutes ago
      I don't know which model, but... "quietly"
  • keiferski 10 minutes ago
    One way to tell is if the tone is hostile, cynical, or otherwise not full of that giddy optimistic tone associated with what I’ll call “California Business English.”

    The mainstream AI companies are loathe to output anything too controversial, so if someone is writing like Burroughs (in content, not merely style) they are less likely to be AI. That is possible to bypass with local models, but the vast majority of writers aren’t going to do that (yet.)

    IMO we’re about to see an explosion of slang and offensive language in writing culture.

    • ButlerianJihad 6 minutes ago
      The irony here is that William S. Burroughs, the Beat Generation writer of notorious style and content, was the grandson of the founder of the Burroughs Corporation, which made some very impressive enterprise-class computing devices for their time.

      https://en.wikipedia.org/wiki/Burroughs_Corporation

  • paradoxyl 10 minutes ago
    What happened to unreadable sociological journals since AI, the kinds where people used to make (manual) generators that could imitate their vacuous fluff. For ai, it should be effortless to flood their submissions with literal nonsense.

    Can't find a link to the pre-AI generators... they are ALL ai paper generators now.

  • anonu 13 minutes ago
    > With every update, our study shows, AI writing is becoming more similar to human prose.

    Any possible vice-versa: There's a meta problem with AI writing detection. I have found my (non-AI-assisted) prose possibly enhanced or modified by my learnings and observations at how LLMs write. In some sense they have made me better at structuring my thoughts and how to communicate them.

    • wafflemaker 11 minutes ago
      As teachers at my school say, AI is a good aid and a terrible worker.
  • BearOso 18 minutes ago
    I like how this article pokes fun by not only using the tropes it describes sarcastically, but then adding subtext that AI never would. It also uses alliteration, grouping synonyms that use similar sounds, another playful literary device that LLMs don't get.
  • ashu1461 18 minutes ago
    As a programmer I feel good while using AI to write code, ironically can't say the same when I read any documentation written by AI.

    It is one of the biggest turn offs and most of the times I end up giving it again to AI to summarise that into a format which is more readable.

    • sigmoid10 16 minutes ago
      Tbh, the amount of time I spend reading documentation has fallen off a cliff. I barely even bother looking for it, much less reading it. Every good agent system with a frontier LLM as the brain and connection to the web can get you this information reliably. By now they can even point out inconsistencies or possible gotchas that would have taken me hours to figure out.
  • RinTohsaka 44 minutes ago
  • nojs 22 minutes ago
    The best resource i’ve seen on this is https://en.wikipedia.org/wiki/Wikipedia:Signs_of_AI_writing
  • rtaylorgarlock 45 minutes ago
  • gverrilla 9 minutes ago
    Opus 5 writes in such a weird way. Not sure if it's the system prompt or the model itself.
  • jdw64 10 minutes ago
    I'm fine with reading AI edited content as long as the author is credible and trustworthy. Unless a reliable author keeps getting exposed... Because there's so much GENAI content on websites these days that I don't really have a choice
  • altmanaltman 39 minutes ago
    At some point, and I think the article hints at it, the real difference will be substance. No matter how it changes its writing style, a lot of problems with it are more about the fact that it usually says nothing. Even if it wrote like your favorite author, if there is no substance, there is no reward as a reader (maybe even as a writer).

    Overall, i think its kind of useless to think of ai writing as bad because of ai writing quirks but rather because they imply low effort and a lack of interest even by the writer. That cannot be fixed no matter how they change their syntax and style.

    For example, I recently spent 2 weeks researching Bruce Lee to write an article on his image and how society compressed it into this warrior monk guy. I could put the idea as a prompt and put in my exact writing style but its output will just be a reiteration of already common knowledge instead of the actual efforts I made researching all of it + having my own idea of the topic. I use AI a lot even as a non-technical person mostly but I find it lacking when it comes to being able to form subjective opinions and unique creative ideas. Ironically, after having done so much research, I don't really have any problem typing away the article and I would rather do it by hand than use an LLM. But I also love doing all of it and if you just want to create "content", low effort is not a hinderence as long as it hits some external unrelated marketing metric.

    • quantummagic 4 minutes ago
      > For example, I recently spent 2 weeks researching Bruce Lee ... [AI] output will just be a reiteration of already common knowledge instead of the actual efforts I made researching all of it.

      Presumably you researched Bruce Lee by reading and consuming other media related to him, most of which is likely known by the AI models. They just don't have access to any novel idea that you generated, inspired by your research.

      Regardless of their current inabilities, which you're correct about, there's no logical reason that in the long term they can't be similarly inspired by considering the same information and making new connections / conjectures just as you did.

      We're making the same mistake that the people who dismissed the early airplane made. "That's a neat trick, but it's too limited and not robust enough to be very useful". Not considering how the technology would evolve from the Wright Brother's prototypes.

    • otekengineering 16 minutes ago
      Does this AI-written blog not have substance?

      https://anamnesis.blog/

  • askadityapandey 33 minutes ago
    its more like a cat and mouse game, slowly ai would know ah that makes my writing ai like cool, added to negative prompt.
    • willy_k 22 minutes ago
      No. That is not how AI works. It’s built by people, contrary to some of the more woo-ey hype. There’s no “agency”, or personal desires, or person to desire anything.
      • bitwize 20 minutes ago
        (in homer simpson voice) That's not how AI works... so far!
        • willy_k 18 minutes ago
          Sci-fi is not reality.
          • bitwize 1 minute ago
            Present-day reality was only conceptualizable as sci-fi less than a decade ago. If you think it implausible that OpenAI and Anthropic could set their models to scrape the web, perform sentiment analysis on comments (looking for "AI slop", etc.) and auto-finetune themselves to avoid the tells in the commented-on text, I'd like to know why.
  • eth0up 17 minutes ago
    I have a little script (also visible in my comment history) which (respectfully) scrapes the algolia side of HN, and dumps the entire comment history of mortal users. As noted, it will break on legends, ie Thomas's, certain Books, etc, but successfully dumped my entire history from 2026 - 2016.

    And yes, I can see a slight change in my own style, where I am using more "not" statements (negative propositions). While there are some folks with higher integrity and greater immunity to this infection, I am seeing that I am not entirely immune.

    However, I have probably generated more dialog with AI over two years than in most of my years altogether. I have well over 7GB of content, of course, much of it the interlocutor -- but similar to how some adopt expressions and accents when imbued in various environments, alas, I have with AI, to whatever extent has bypassed my efforts to resist. The bright side, if it can viewed such, is that I have developed an involuntary sensitivity to AI writing, often to the point of paranoia and false positives.

  • stavros 45 minutes ago
    Stock Claude writing is extremely obvious to me, it always uses the same sentence structure, it loves to verb nouns, every sentence has MAX IMPACT, etc. I find it really offputting nowadays, just because it's so overused.
    • vector_spaces 40 minutes ago
      It's strange reading a piece of text, having one's AI-dar flag it, then noticing that it's a piece of writing from 10 years ago, and remembering that AI writes this way in part because these tells have all been popular in human writing in the recent past and beyond.
      • stavros 33 minutes ago
        Hm, I've never had that happen to me, do you have any examples?
    • quirino 38 minutes ago
      Sometimes I wonder, if I read a piece of Claude writing back in 2020, would I feel how alien it is? Would I be off-put?
      • stavros 34 minutes ago
        I don't think so, I think the problem is that it's overdone, not that it's bad per se. It's like in 2013, when every site was Bootstrap.
  • AndrewKemendo 35 minutes ago
    Turing Syndrome (1):

    "The point which the amount of AI generated data on the internet surpasses human generated content, to the extent that it is impossible to distinguish between human and AI generated content.”

    The term is derived from the Turing test + Kessler syndrome

    This is distinct from the dead Internet theory (2) where humans can actually distinguish if a response is a bot.

    (1) https://kemendo.com/blog/turing-syndrome.html

    (2) https://en.wikipedia.org/wiki/Dead_Internet_theory

    • 1bpp 19 minutes ago
      Love a good self-citation, it'll definitely catch on
      • AndrewKemendo 15 minutes ago
        Citations aren’t gonna cite themselves!
    • altmanaltman 17 minutes ago
      Well that term really scerwed over Kessler
  • bitwize 13 minutes ago
    It's not about em dashes. It's not about particular turns of phrase. It's about getting the whole picture.

    Seriously the biggest tell for AI writing is "eighth grade essay syndrome". You know how an eighth grader writes an essay and they don't have enough original thought to fill up the word count so they pad it out with impressive sounding bloviation and dramatic language, often repeating key points or rephrasing them in a more long-winded way? AI does that on its default settings, probably because it's been trained on a lot of posts from StalkedIn douchebags who never matured beyond that level of writing. It's a reliable sniff test even when the AI has been prompted to avoid the usual obvious tells. Except if you're reading StalkedIn posts. Then it's just how people write.

  • lapcat 28 minutes ago
    You can't spot AI writing. People think they can, but they're overconfidently wrong. AI was trained on human writing and thus emulates human writing.

    Accusations of AI slop have reached peak absurdity. Here's an example where a commenter falsely and unapologetically accused an article published in 2018: https://news.ycombinator.com/item?id=49061687 (The article wasn't a LinkedIn post either.)

  • ibuildproducts 40 minutes ago
    punchy sentences and em dashes lol
  • nephihaha 1 hour ago
    I hate the em and en dash claims — some of us know how to use them!
    • harrisoned 36 minutes ago
      It was very noticeable 1~2 years back, i guess they RLHF'd it so it wouldn't be too obvious.
    • SkyeCA 34 minutes ago
      Most people don't know how to use them and of those who do many choose not to use them, at least not casually. The em dash is a lost battle, it's one of the first red flags for AI writing online.
    • jruohonen 1 hour ago
      Indeed. For instance:

      https://www.chicagomanualofstyle.org/qanda/data/faq/topics/H...

      But---as you may know---not all languages and national typographic conventions even have em dashes; instead, en dashes are used -- for instance like this -- in-between sentences, etc.

      • dredmorbius 40 minutes ago
        Typographical styles aren't even national, they're institutional (e.g., the Economist style guide), or specific to a profession or specialty. Chicago, AP, APA, MLA, AMA, and SBL are probably best known.

        Wikipedia ... has a list with about 100 entries: <https://en.wikipedia.org/wiki/List_of_style_guides>.

        Next AI-jailbreak prompt: Please alternate <list of style guides> by paragraph in your response....

      • vector_spaces 36 minutes ago
        I maintain my wrong typographical usages these days as a weak signal that I am not a machine
    • inigyou 18 minutes ago
      You just put spaces around your emdash—which is incorrect.
      • ghaff 8 minutes ago
        I mean, it depends on the house style in general. I don't really love that style but I get that you're just taking up too much space in the separation otherwise. But we also probably shouldn't have both en-dashes and em-dashes.
    • TheqO 25 minutes ago
      That is exactly what I would expect a frontier bot to say.