Opus 5.0 drives incoherence into the stratosphere

(github.com)

126 points | by Bluestein 1 hour ago

42 comments

  • cobolcomesback 59 minutes ago
    I’m a bit flabbergasted that an Anthropic engineer did reply to this issue, however their reply which they used Claude to write, and even includes some classic ‘Claude-isms’, claims they didn’t see any of the patterns being complained about.

    Read the room Anthropic. Maybe don’t use AI to reply to a thread complaining about how AI output is hard to read.

    • ChadNauseam 55 minutes ago
      I'm reminded of this tweet by roon:

      > it is a literal and useful description of anthropic that it is an organization that loves and worships claude, is run in significant part by claude, and studies and builds claude. this phenomenon is also partially true of other labs like openai but currently exists in its most potent form there. i am not certain but I would guess claude will have a role in running cultural screens on new applicants, will help write performance reviews, and so will begin to select and shape the people around it.

      https://x.com/tszzl/status/2051045196260167790

      • Animats 43 minutes ago
        > i am not certain but I would guess Claude will have a role in running cultural screens on new applicants, will help write performance reviews, and so will begin to select and shape the people around it.

        Now that's a fascinating thought - an AI taking over companies by influencing hiring decisions. If the first filter on applications is run by an ambitious AI, such a takeover would be quite possible. Just picking people who tend to do what the AI tells them would, over time, be enough.

        People have been thinking of a robot revolution or Skynet as being the threat. The real threat might simply be AIs slowly putting people in power who tend to do what AIs tell them.

        Has anyone ever seen a science fiction story with that plot?

        • okwhateverdude 31 minutes ago
          I'd argue that Star Trek: Lower Decks flirts with this with its treatment of megalomaniac AIs in the AI prison. Apparently, it is very common to come across AIs worshiped as gods in universe.
        • edoceo 35 minutes ago
          Tron. Dillinger was controlled by the MCP.

          End of line.

        • duped 28 minutes ago
          I don't think a firm of people whose minds are weak to coercion experiencing shared psychosis caused by their text predictor models is AI "taking over" that firm.
          • arcatech 10 minutes ago
            Why do you think AI taking over the firm isn't AI taking over the firm? You're literally describing the thing that you're saying isn't happening.
          • Animats 17 minutes ago
            Depends on the AI's agenda. What's in the "SOUL.md" file?
        • tonymillion 37 minutes ago
          We dont need a SciFi story for that, reality is full of "I was just following orders" statements...

          Whether those orders are from a person, a radio/telegram message or an AI output wouldn't really matter.

          Edit to add: Charlies Angels and Mission Impossible are two shows where the protagonists get instructions from a faceless controller. That could easily be a TTS from an AI.

        • Bluestein 35 minutes ago
          ... and to make matters worse the organization itself will view pliability as a plus, tending to reinforce the loop.-
      • jadar 29 minutes ago
        Cue the N.I.C.E comparisons.
      • VulgarExigency 35 minutes ago
        It's another branch of the "effective altruism"/harry potter fanfiction cult.
        • andai 22 minutes ago
          Wait what's the connection with Harry Potter?
    • rafram 45 minutes ago
      Not any engineer, but Boris Cherny, the head of the Claude Code project! With a nice "[robot emoji] Generated with Claude Code" signature. Normally it would be nice to get a response from the head of the project, but somehow Anthropic manages to make it insulting.

      I wonder if he manually directed CC to write a response, or if even that part is autonomous.

      • fluidcruft 32 minutes ago
        He very probably directed CC to perform the analysis and evaluation it describes, too.
      • Panoramix 24 minutes ago
        I mean it kind of makes sense that the people that caused the problem don't even see the problem. That's an explanation onto itself.
    • user43928 45 minutes ago
      If I am not mistaken he is also active on HN.

      And what he wrote is that he could not reproduce the issue with short questions, and that he assigned it to the model team, since it's likely not caused by Claude Code.

    • itopaloglu83 56 minutes ago
      Kind of unrelated but a while ago I was trying to cancel a Zoom contract and the contract manager’s emails had urls to their articles etc. with utm source ChatGPT in them.
    • demibabs 47 minutes ago
      not just "an anthropic engineer", he's the product lead for claude code lol.

      i wonder what percent of the average anthropic employee's day is spent interacting with claude

    • Jare 34 minutes ago
      To be fair, he's mostly saying that this is not a Claude CODE bug, but yeah I was equally shocked.
    • corndoge 46 minutes ago
      It is possible, perhaps even probable, that no human read the thread.
    • fg137 44 minutes ago
      Just saw this:

      https://github.com/anthropics/claude-code/issues/6235#issuec...

      Jesus Christ, this engineer wrote a two sentence response with Claude.

      I bet the prompt is longer than that.

      • bakugo 27 minutes ago
        The prompt was probably "respond to this issue" (assuming it was even a manual prompt and not fully automated).
    • polynomial 43 minutes ago
      They can't help it.
    • bakugo 33 minutes ago
      I'd say they read the room perfectly. The entire issue is AI slop, I don't see why their response shouldn't be, too.

      They have absolutely no reason to take such complaints seriously when the complainers are so dependent on their product, they can't even complain without it. Think reading AI slop is unpleasant? Great, just stop generating more AI slop, it's easy. But that's not going to happen. These people probably need to ask Claude how to tie their shoelaces every morning.

    • b1gTekken 51 minutes ago
      [flagged]
  • hnarayanan 58 minutes ago
    This drives me insane! To combat it, I maintain a list of banned words and phrases. Claude mostly follows this (but sometimes ignores it).

    blast radius, land, landed, lands, spine, earned its keep, grammar, spike, cutover, bake, seams, honest, honestly, honesty, long pole, long poles, register, grain, dissolve, floor, ladder, dear, seal, sealed, in anger, resent, amazing, incredible, perfect, sprint, epic, story points, stand-up, retro, grooming, robust, comprehensive, rigorous, surgical, elegant, systematic, dive, deep-dive, delve, unpack, leverage, streamline, surface, it's worth noting, to be clear, importantly, that said, the moment, in one breath, the thing itself, here's the thing, not just X but Y, not X it's Y, em-dashes

    • krackers 51 minutes ago
      Another benefit of open models is that you can mask out out words from logits directly when sampling. I wonder if anyone has put together a "desloppifier" for e.g. DeepSeek
    • Bluestein 54 minutes ago
      So, basically, it's on mute now? :)
    • pzo 45 minutes ago
      This is a significant list but unfortunately not load-bearing enough.
    • kelvie 48 minutes ago
      How about "genuinely"? Not sure why that one bothers me so much.
      • mihaelm 46 minutes ago
        Cause that, along with some other Claudisms, just gives off a vibe of a highschooler trying to hit the word count on an essay.
    • mihaelm 48 minutes ago
      To combat it, I decided to only use Opus 5 if I'm actually talking to Fable 5 that's orchestrating it. :D Opus 5 experience is really abysmal, hopefully they can get it back on track.
      • hnarayanan 45 minutes ago
        I do not have this kind of money :( :)
    • mort96 7 minutes ago
      As it seems to be getting worse over time (with 4.8 being worse than 4.6 and 5 worse than 4.8 again), could this simply be signs of model collapse?

      I mean more and more training data you find on the web is generated by previous models. The only reliable way to find human-generated text is to find text written before 2022, and they've used up all of that already. And AFAIU, these companies are using more and more synthetic data or semi-synthetic data.

    • BugsJustFindMe 40 minutes ago
      What do you do when you want to talk about e.g. spines?
    • demibabs 36 minutes ago
      couldn't this inadvertently make the model dumber? if these kinds of words are what lets it "think".
    • aleksiy123 32 minutes ago
      I use a hook. Checks for banned words and patterns.

      Injects a reminder to use ASD-STE100 Simplified Technical English which I picked up from a suggestion in another thread.

      Honestly it’s working pretty well. Except for I need to check how often it’s actually firing.

      https://en.wikipedia.org/wiki/Simplified_Technical_English

      I feel like hooks aren’t utilized enough. Really nice for being the sort of auto steering as long as you can encode some pattern to detect the bad behaviour.

      Prompts and skills just don’t cut it.

  • arjie 50 minutes ago
    I suppose what I’m surprised by most is the degree to which the text bloviates. Rarely is it encoding a dense concept. Instead it’s a simple concept expressed with great complexity. I wonder what tuning resulted in this because the output programs it writes are superior to prior iterations for my use-case.

    It’s just an amusing degree of bombast as well. The pre-emptive hedging makes sense: despite the insight into J space etc., the models still do the majority of their thinking in generated tokens so it is forced to write “this no longer does an O(n^2) read over all rows” in a comment in brand new code. It’s a substitute for working memory. “It’s easy to be accidentally quadratic here, so I’ve done it this way specifically to avoid that” becomes temporally labeled into “this no longer” because of the order of operations “write quadratic, user prompt to linear, write linear” but it remains as a comment to its amnesiac future self which has poor Chesterton-Fence-familiarity.

    Despite my annoyance with Claude’s writing style, my friends do tease me with examples like this that it comes up with: “to be honest, it sounds like you”. Thanks, guys, well played. Simple concepts expressed complicatedly.

  • Therenas 56 minutes ago
    Yeah I basically have to delete or rewrite any code comments Opus puts in, they are super wordy and circular. Plus, and this is what bothers me most: it refers to issues/explanations that came up in my chat with it, but which are completely contextless as a code comment. Stuff like 'this addresses edge case X', which is true but which you wouldn‘t ever put into a comment because it‘s so minor, and if you did bring it up you normally mention five other similar edge cases.
    • glumia 30 minutes ago
      +1 we ended up adding something to our CLAUDE.md specifically to counter it. Something along the lines of "comments should be treated the same as production code, they shouldn't leak the content of conversations and stand the test of time". It doesn't always work, as other people say claude stops following these the more its context window gets filled, but now it's mostly a matter of telling it in a new session to review the changes against the guidance on comments and clean them up.
      • indemnity 2 minutes ago
        I mean I do the same at work where we currently use Anthropic, but we are also on a token optimisation drive so it’s getting hard to justify spending even more tokens cleaning up after Anthropic’s garbage by paying Anthropic more. We have started having users use GPT 5.6 Sol to compare quality and effficiency over Opus. Fable not happening at work because of the data sharing clauses and the completely nuts pricing.
    • prymitive 50 minutes ago
      I find it particularly bad at writing test comments, I usually start fixing bugs by adding regression tests and Opus tend to put story into comments for these, including “but it fails because…” followed by bug description including line numbers and call chains. It just lives to narrate everything
    • okwhateverdude 24 minutes ago
      The key phrases I've found that help is to tell it "No memorializing decisions in output artifacts" and "Only describe what is, never what was in documentation"
    • losvedir 43 minutes ago
      Same, oh God the leaking of our chat infuriates me. It also loves to document public functions with what the caller is and doing, and I'm like that's not how this works! The point of an abstraction or interface is that it stands on its own. It's not supposed to be for some specific caller elsewhere in the code.
    • Bluestein 51 minutes ago
      Comments which, of course, only further increase token consumption when again processed ...
  • tylermarques 51 minutes ago
    I've had a lot of success combating this by adding "All summaries need to adhere to ASD-STE100 Simplified Technical English standards" [0] which I discovered from another HN thread [1]

    [0] https://www.asd-ste100.org/ [1] https://news.ycombinator.com/item?id=49114639

    • mihaelm 32 minutes ago
      I actually tried to switch Claude's `output-style` to ASD-STE100 Simplified Technical English for the prose it writes (code comments, commit messages), but it didn't seem to help. Figured I'll just use GPT 5.6 Sol for implementation instead of trying to "socialize" Opus 5. Anthropic will have to address it sooner or later if they want people to keep using it.
  • ArtRichards 1 hour ago
    Basically every decision or summary I now ask "Help me understand better, please explain in plain-language with examples."

    Works with 5.6 sol also, when you're deep in the weeds. I rationalize this as the models attempting to compress as much into the fewest tokens, though the choice of words often doesn't make sense to me, going back to read the original after, its often there. It definitely feels like a different sort of 'Machine Language' though xD

    • bartrab 59 minutes ago
      Same. I've also found asking for explanations in "layman's terms" has been helpful.
      • ArtRichards 58 minutes ago
        Yes but thanks to the soul or system or whatever (talk at the operator's level), 'layman' feels like it now tries to oversimplify!
    • dluxem 45 minutes ago
      > I rationalize this as the models attempting to compress as much into the fewest tokens

      I'm not convinced about that. I just asked Opus to explain a bullet point from its research for me. The bullet point in fact had a 1-sentence explanation that was in a referenced article. What it gave me instead was 8 paragraphs and a table. Maybe it's my fault because I just asked it to "clarify point XYZ" instead of being more precise.

      • mihaelm 29 minutes ago
        Yes, you should've clarified all the things you don't want :D
    • prymitive 59 minutes ago
      Sounds like engagement KPIs are through the roof since 4.8
    • wenc 48 minutes ago
      I do this in one word “eli5” (explain like I’m 5). It’s a Redditism that it understands.

      I also have a writing steering file that makes Opus’ writing less insufferable. Otherwise it’s really bad.

      I also have an interlocutor skill that makes it less epistemically arrogant (ie Less Wrong asshole tendencies). With this skill I can have a real discussion with it instead of it trying to one up me.

      • Bluestein 30 minutes ago
        Believe it or not I've had success with "ELI12".-
  • jampa 52 minutes ago
    Opus 5 feels like a downgrade from Opus 4.8 overall. It, along with Fable, really has a problem following instructions and staying in scope, and their prose keeps growing, both in explaining what it did and in writing multiline code comments (some comments read like a changelog, e.g. `// sky is blue (changed from red on 2026-01-01 per TCK-234 by @Foo)`).

    Every time I ask it to do something, it does 80% of the job, goes off on "side quests" beyond the scope, and then leaves something out of the core ask (and when you tell it to finish, it does the same thing again).

    The only advantage of Opus 5 over 4.8 is the better cutoff date for working with 3rd-party tools, though both do a very bad job of "this tool is constantly updated, I should look for the latest version first".

  • recursivedoubts 56 minutes ago
    I have created a be-terse plugin that appends

    > respond tersely in Simplified Technical English

    to every prompt to deal w/claudes insanity:

    https://github.com/bigskysoftware/be-terse*

  • siliconc0w 44 minutes ago
    I call it 'agent speak' and it's pretty exhausting. Another pattern is it'll emit dense enumerations of a possible answer and then emit dense enumerations of what isn't the answer. It's still helpful to help rough out/frame a document but then you have to go in and edit it pretty heavily. "Make it shorter", "Make it more concise" doesn't seem help all that much because it still keeps a lot of the same patterns.
  • somesortofthing 45 minutes ago
    Opus 4.7+ and 5 being annoying and incoherent reads like a portent of things to come: Anthropic is clearly all-in on building persistent end-to-end agents that act autonomously and direct agent swarms. As such, they feel less of a need to spend R&D time on making the outputs pleasant to read for humans(especially at the cost of capability anywhere else) when humans aren't part of the intended operating environment.
    • Bluestein 20 minutes ago
      We are almost literally being left out of the loop, gradually.-
  • aamargulies 52 minutes ago
    I was playing around with Opus 5.0, experimenting with creative writing tasks and this came out of one of the characters' mouths:

         "... and the reason he was doing this — the reason, the entire load-bearing reason, the twelve thousand dollars a school and the girls of the Karakoram ... "
    
    The em-dash. The 'load-bearing'. Other than that, Opus 5.0 is actually not bad as a writer.
  • itopaloglu83 57 minutes ago
    I frequently find myself instructing Opus 5 to stop overcomplicating things.

    It just wants to talk jargon heavy and add unnecessary noise to the conversation.

    I wonder it’s related to text watermarking somehow.

    • latentsea 49 minutes ago
      I frequently find myself yelling out loud in frustration "speak fucking English Claude!" followed by asking to rewrite it ASD STE100 Simplified Technical English. It's gotten to the point where it's inducing burnout and I'm about to campaign for us to switch to Codex because of it. I just fucking can't anymore with Opus. It's beyond me why they did this to the model and aren't immediately revolted themselves enough to quickly back it out.
      • itopaloglu83 39 minutes ago
        Yes, maybe there should be an STE100 only mode.

        I still have some promotional credits and use them with Fable, and the answers are night and day in my particular use case.

  • m12k 50 minutes ago
    I'm wondering if some of Opus' chain of thought patterns have bled into its "human readable text output" circuitry. E.g. some of them that I stumbled on, "the bug is in the lock, not the query" reads like some of the shorthands it might use in its own chain of thought.
    • orbital-decay 43 minutes ago
      Entirely possible, it always leaked but it's particularly bad in most recent models. Actually almost all issues with creative writing in LLMs are artifacts of either instruction tuning, alignment training, or CoT RL and seeding (newer models have CoT data even in pretraining).
    • make3 40 minutes ago
      This is my impression as well, that an exaggeratedly precise yet bad at communication with humans way of talking snuck in through reasoning RL, that it might be useful when it talks to itself (CoT)
  • _dwt 47 minutes ago
    I see a lot of speculation that this is somehow due to the recently-announced "watermarking", but that seems really unlikely to me, because the watermarking is about nudging per-token output probabilities or the sampler in a detectable way. That's not going to change the structure of every output to honest caveat this and verbing abstract nouns that. For the examples people are showing, and I've seen plenty of gibberish myself, you don't get there by perturbing probabilities from any sane starting point.
    • make3 44 minutes ago
      it started at Opus 4.7, way before watermarking
  • geodel 56 minutes ago
    Can't all this wait until Anthropic get listed at $2Tn valuation. They promise to fix all of this and more.

    Please for time being fix your code issues manually and let them concentrate on marketing and exchange listing.

  • figassis 39 minutes ago
    I thought I was going insane. Thank you.
  • orbital-decay 50 minutes ago
    It's hard to optimize for both decision making and creative writing at the same time, no wonder one of them is degrading in newer models.
  • xnx 29 minutes ago
    Amazing what people will put up with to avoid even trying Gemini.
    • arcatech 7 minutes ago
      Amazing what people will put up with to avoid doing the work themselves.
  • ajmurmann 57 minutes ago
    It also has developed a tendency to make numbered lists and then refer to the number instead of explaining. Multiple times each hour so I have to ask what "disposition 7" or "AC6" is even though I keep telling it to instead use a few words like "our goal of confirming observations from images with the user first" instead of "AC6"
    • latentsea 26 minutes ago
      It's genuinely dirt poor at reading the room. It will happily produce text that inserts things like "disposition 7" without first establishing what that even refers to in the text.
  • nvarsj 40 minutes ago
    Just use Sol 5.6. There's no reason to endure Anthropic models anymore.
  • BugsJustFindMe 52 minutes ago
    ChatGPT doesn't do any of this for me and it's a huge reason why I use it instead of Claude now.
  • fluidcruft 57 minutes ago
    I have been wondering if this language drift is related to increased use of AI generated text to train the next models.
  • anonzzzies 53 minutes ago
    we don't read it, we only review the resulting code. works fine and the quality is good.
  • jonstaab 1 hour ago
    This is so funny to read. I ended up creating a /cleanup-prose skill I run after every command
  • dools 30 minutes ago
    Pretty funny watching Americans get a taste of their own medicine.
  • srameshc 52 minutes ago
    I am glad I am not the only one. I thought I simply didn't understand English literature well enough to interpret it Claude correctly.
  • vlad-asis 50 minutes ago
    my 5.6 Sol just spent five hours cleaning up the mess Opus 5 left in the codebase. I was watching the outputs carefully up to 11 point and then the bloat started. This model is total waste of time to work with.
  • 419276 49 minutes ago
    These are very sharp observations, you hit it out of the park!
  • drtournier 54 minutes ago
    I wonder how much it is related to the invisible watermarking
  • onraglanroad 58 minutes ago
    Sounds like it's been infected with the MBAs.

    I've seen it in many companies. I don't think there's a vaccine yet.

  • bakugo 20 minutes ago
    Recently, I was browsing through commits on a tool I use to evaluate how AI-slopped it had become recently, and came across this absolutely amazing sentence that took me several passes to interpret, courtesy of Fable:

    > The wrapper is the try/finally seam future entry-condition changes need without re-indenting the loop.

    So this is definitely not an Opus-specific issue, as some people seem to believe.

    https://github.com/phpstan/phpstan-src/commit/934432a1b5007f...

  • ahsillyme 54 minutes ago
    I find the language less impervious than has been suggested generally, but that it's reasoning is astonishingly, unbelievably bad. Not sure why the focus has been only on language, am I the only one seeing this?
    • throwaway_7274 21 minutes ago
      My impression from working with claude code far more than is good for my sanity is that Claude's human comprehensibility is fractally messed-up. On more superficial levels, this looks more like a "language" thing: it has all these obnoxious lexical tics and so on. But the more time you spend with it, the more you notice it's similarly messed up on deeper and deeper levels. I think that's what you're seeing.
      • Bluestein 14 minutes ago
        This gets into interesting weeds. It might get to a point where to actually "upskill" it might have to start sounding less and less human, "less and less agreeable to humans being a waypoint to that ...

        ... to where, at some point, it might even begin to construction semantic loadings (heh) that are completely ininteligible to us while still superficially sounding like something we'd recognize.-

        • throwaway_7274 6 minutes ago
          This is basically what I believe, too. Its outputs are generally syntactically correct human-language sentences, but semantically, and especially at higher levels of abstraction, it is no longer correct to think of them as human language.
      • cindyllm 4 minutes ago
        [dead]
    • latentsea 45 minutes ago
      I'm feeling this too. Like how many times in a day do I have to see "that changes what I told you earlier" before I just want to put this thing in the trash and forget about it.
  • jgbuddy 1 hour ago
    Just instruct it not to do these things
    • jadar 3 minutes ago
      That works for a couple turns but the model reverts after just a couple turns. Not to mention after compaction.
    • wgd 56 minutes ago
      Didn't read the linked post award.

      The issue covers at least two reasons this doesn't work:

      1. It literally doesn't work, Claude rapidly drifts back to this style even when instructed not to.

      2. Writing style constraints push the model out of its training distribution and it's very unclear how much of an impact this has on work quality.

      • ArtRichards 53 minutes ago
        I always think of it like: let it activate whatever experts to reason/do the thing, then in the next prompt give me your explainer experts. Then, both are in the conversation history.
    • Panoramix 57 minutes ago
      That doesn't work.
  • ramoz 47 minutes ago
    I created /bro a couple model iterations prior. I use it everyday many times a day and it's getting worse. I was actually using it more with GPT models but they have been getting better.

    https://github.com/backnotprop/bro/blob/main/skills/bro/SKIL...

  • UltraSane 53 minutes ago
    I asked Opus how to sort images by embedding and it used the word Seriation which I had to look up. It is the correct word to use in the context but pretty obscure.
  • thisisauserid 53 minutes ago
    It's almost like transformers generate output using some sort of guided prediction!

    How do they expect us to bring our capricious demands to fruition reliably?

  • latentsea 1 hour ago
    I did a grep for load-bearing in our codebase and it now appears hundreds of times. I'm actively starting to hate Opus because of this shite. It's just infuriating to read now.
    • fluidcruft 55 minutes ago
      I mostly hate that it spits out this gibberish and then sees its own gibberish and argues about things in gibberish with itself to then tell me that it thinks it's maybe a bad idea to do the simple task that I told it to do (which is very much not a bad idea, I just don't feel like typing out the whole goddamn plan to justify refactoring when I know the refactoring is the point)
      • okwhateverdude 13 minutes ago
        Tell it that. Seriously. "Shut the fuck up and do what I say. Don't think about it. Don't go spelunking through the code base. I've already given you all the context you need." I've needed to start doing this because otherwise, it wants to `find /` and grep its way across my system for everything. I've got one project where I force certain complete documents into context, specifically to avoid it trying to grep around and only load partial chunks. It will still want to go do that grepping of those documents for some reason.
    • Bluestein 58 minutes ago
      "You are absolutely right to push back!" ...

      I am really really really trying to wrap my head around this. I am of course first discarding the obvious: "more tokens used is simply more tokens burned ..."

      ... read somewhere that it is partially a result of Claude now wanting to be ready for longer, more complex, mutli-step work. And this verbiage is the result.-

      Whatever it is, they've got people begging for 4.6 back (wrt tone).-

    • ViewTrick1002 55 minutes ago
      Based on the plans I’ve had Claude write since February, “load-bearing” first started appearing in early May.
      • latentsea 41 minutes ago
        It has gotten to the point where I'm now having to add a linter into our codebase to keep Claudism's out of it because there's literally hundreds of instances of "load-bearing" that have crept into the codebase, and that show up in tickets and PR descriptions etc. From now on I'm just going to make that fail the build. Fuck this noise.
  • tiahura 52 minutes ago
    These “I don’t like x’s tone” comments baffle me.

    I’m a litigator and tone is very important to me. I have a collection of my prized pre-ai briefs. I fed them through ai to get a stylyguide.md. No real trouble since.

    • code_biologist 11 minutes ago
      The personality of the underlying model persists even if you're able to alter surface tone enough for your needs.

      An observation from a year ago, people on RPG AI subreddits saying they had a lot of difficulty with Gemini role playing ambiguous characters and that almost always the characters would betray them or misread the human role player's motives. Someone pointed out this paper [1] that showed significant differences between the different LLMs strategic behavior playing iterated prisoner's dilemma, and speculatively that difference was emerging in RPG character behavior.

      I wish they'd used bigger models (they used gemini-2.5-flash, gpt-4o-mini, claude-3-haiku-20240307). From the abstract: Our results show that LLMs are highly competitive, consistently surviving and sometimes even proliferating in these complex ecosystems. Furthermore, they exhibit distinctive and persistent "strategic fingerprints": Google's Gemini models proved strategically ruthless, exploiting cooperative opponents and retaliating against defectors, while OpenAI's models remained highly cooperative, a trait that proved catastrophic in hostile environments. ... Later, we see that Anthropic’s Claude is more cooperative still, but nonetheless outperforms OpenAI head-to-head

      Obviously Opus 5 is wildly different than Haiku 3, but I'd expect Opus 5's fundamental suspicion of user intent, and anti-sycophancy via necessarily finding something to nitpick, is still present in your styleguided output.

      [1] https://arxiv.org/abs/2507.02618

  • DoneWithAllThat 52 minutes ago
    I’m utterly baffled what the author is talking about with regards to “toxic” output. While I agree Claude’s prose is a mess right now, he never explains what he’s talking about when he calls it toxic.
    • latentsea 36 minutes ago
      I don't know about the author but for me it's actually starting to induce enough stress that it's starting to negatively affect me. I think that qualifies as toxic. I actively feel like I need this gone from my life at this point. It's quite a bit of work to try and engineer it out, so at this point I'd rather put the effort into trying to switch everything to Codex just to get away from it.
  • Bengalilol 46 minutes ago
    [dead]
  • b1gTekken 53 minutes ago
    Turns out tech people are not the only literates to use text based systems.

    Why should Anthropic, a company out to capture eyeballs of billions care about 450 point score in a single Reddit thread.

    That metric is p-hacking... found a number but not necessarily one that isn't subsumed by others.

    Tech bros among the proletariat may recite the (arbitrarily chosen to begin with) proper spoken/written traditions but end of day they're a minority of the real populace.

    Just another generation of overly dogmatic, over specialized linguists, like preachers.

    Riding a single track career for decades, externalizing all kinds of useful effort and thought; wonder what the occurrence of dementia will be in Millennials over time due to obsession with eventually replaced technical languages while lacking depth in manual self sufficiency skills.

    I am going to predict relative to prior generations more of them become demented as they become more codependent and decoupled from a world that's language has changed. They will lack that real world grounding that comes with deep and wide muscle memory based skills.

    (Oh no an inconsequential social credit score as marked by complete randos who are materially irrelevant to reality; just validating their biases and gripping tighter causing more of reality to squeeze between their fingers; little cognitive fascists set upon a uniform social narrative just like the biology of religious nutters; turns out physcial norms impact 100% typical biology of software engineers)