Clean up Claude 5's token vomit with a separate LLM

(github.com)

104 points | by Bluestein 2 hours ago

36 comments

  • trefoiled 1 hour ago
    I've been grappling with this for weeks, not just in Claude but in Codex as well, which isn't quite as bad but still annoying. AGENTS.md does very little, agents will consistently violate the communication preferences, especially as the session drags on. It's incredible to me that there's no good way to reliably change the way an LLM responds to you that a workaround like this would even be necessary. It seems like such a failure to live up to the promises of the product.

    The baked in communication style of these models is so obnoxious it's impacting my work. The best way I can describe it is that everything is optimized to impress the user and make the agent sound more authoritative, but the way this is done is through deliberate obfuscation, inserting inappropriate and extremely dense jargon, and bizarre, stilted metaphors. It's like they've been trained to produce output that's hard to read.

    • sroussey 8 minutes ago
      So many vacuous statements at the seam. This is the hermetic load bearing part, which I confirmed rather than assuming.
    • medwards666 9 minutes ago
      This morning I asked Claude to provide a summary of the work it had done but to '... explain it as if you were talking to a moron' and it actually turned out a quite comprehensible summary.

      So going to continue trying that as a command structure going forwards...

      • Bluestein 3 minutes ago
        "From neuralese to moron-code ..." :)
    • svara 38 minutes ago
      I'm probably going to be going against the grain here, but I think it's not as bad as it looks at first.

      I was similarly frustrated a few months ago, but have noticed I've started to learn the idiom.

      Its use of "dense jargon" and "stilted metaphor" is actually surprisingly consistent - it's speaking its own dialect, and you get used to it.

      After a while it gets much easier to read and even becomes somewhat efficient, I think, since the odd metaphors it uses often have a precise meaning in Opus-ese (Fable speaks a really similar dialect).

      • dahdum 1 minute ago
        > it's speaking its own dialect, and you get used to it

        Same experience. It’s not very “human” but once you have agents talking to each other the shared dialect and verbosity makes things much smoother in my experience. Fighting against the default feels like an uphill battle with no meaningful benefit.

      • retrac 5 minutes ago
        > Its use of "dense jargon" and "stilted metaphor" is actually surprisingly consistent - it's speaking its own dialect, and you get used to it.

        This dialect is idiosyncratic to you and Claude based on your session history and memory.

        I've noticed Claude's output mimics my writing style.

        > Registers the board implements but whose behaviour is not modelled

        Right down to my preferred spellings.

        As several comments I've read on HN suggest, this jargon which can be so precise in the mind of one person, tends to rapidly fall apart when multiple people try handling it.

        • Bluestein 1 minute ago
          I concur. It even follows some idiosyncratic punctuation if you have it.-
      • crab_galaxy 23 minutes ago
        “Filters, including no filters. The request carries whatever filter object the page already has.

        No step here involves choosing based on meaning. It is a filter, a sort, and a slice.”

        This is from Opus five minutes ago. I can certainly derive meaning from these kinds of statements in isolation, but paragraph upon paragraph of this is unintelligibly dense when trying to work with Claude to come up with a plan.

        The worst part is that it can’t even make its responses make sense when asked to summarize in simple English or < 200 words. It simply cannot be steered to make its prose legible.

      • hellohello2 7 minutes ago
        I agree to some extent about the jargon (Claude has a bigger vocabulary that me, if it knows a useful word I don't I'm fine with learning it), but often times the way information is laid out across sentences just doesn't make any reasonable sense. At least its consistent in the ways its atrocious, sure, but like...
      • stronglikedan 33 minutes ago
        > you get used to it

        And once everyone gets used to it, we'll chide people for writing things themselves, like we're chiding them for writing with AI now, and the ouroboros of life will continue.

    • bcooke 1 hour ago
      Very well said.

      And when you say it like that, I have to wonder how much of this is a natural consequence of RHLF on such a grand scale, when you have millions of people pretty much much skimming chat responses or operating outside their depth and giving unqualified feedback to the models.

      Seems like a lot of people may be reinforcing what sounds smart over what is smart.

      Also as an aside: funny how much the LLMs continue to mirror the human communication they’re trained on

      • akersten 22 minutes ago
        > or operating outside their depth and giving unqualified feedback to the models

        I wonder if the labs are sufficiently prepared to filter this kind of stuff out. I see a lot of non-developers asking development things of Claude, getting confused when they're in over their depth, and getting upset that they don't understand what the model is providing them, giving it bad feedback, and subsequently making the AI worse for the rest of us who know how to use the tool.

    • Bluestein 1 hour ago
      > The baked in communication style of these models is so obnoxious it's impacting my work.

      This is close to the worst thing one could say of a tool for professional use.-

    • bcrosby95 1 hour ago
      > especially as the session drags on.

      This is because these harnesses are missing a very important feature. Anything like this needs to be included with every turn, otherwise the LLM quickly drifts.

      I first noticed it when I wrote a harness for D&D (because it's so damn noticeable there), but now I include this for any harness I write.

    • mbesto 24 minutes ago
      > AGENTS.md does very little, agents will consistently violate the communication preferences, especially as the session drags on.

      Non-determinism at its finest.

    • nycdotnet 1 hour ago
      Unfortunately this may only start to get worse as the AIs are trained on more and more AI generated content.
      • astrange 2 minutes ago
        Pretraining is full of bad writing and it doesn't really cause issues. Writing style comes from post-training. In this case it's gotten worse because they prioritized agentic abilities.
      • zachahn 20 minutes ago
        I'm not super sure if this is true (yet?). I think that these newer LLMs are trained on results (the agent got some code to run with minimal prompting), and not on text. (I think this is called RLVR.)
      • svachalek 41 minutes ago
        This is my personal theory for the cause of this style: Ouroboros. The official OpenAI explanation for how ChatGPT got obsessed with goblins blames it on exactly that:

        ---

        That creates a feedback loop:

        - Playful style is rewarded

        - Some rewarded examples contain a distinctive lexical tic.

        - The tic appears more often in rollouts.

        - Model-generated rollouts are used for supervised fine-tuning (SFT).

        - The model gets even more comfortable producing the tic.

    • nico 1 hour ago
      > AGENTS.md does very little, agents will consistently violate the communication preferences, especially as the session drags on

      That’s really annoying, although it feels like it’s improved some over time.

      Not sure what the fix is, but you could try using a canary to at least get a signal of when things are going sideways (Mr Tinkleberry for reference: https://news.ycombinator.com/item?id=45983698)

    • mannanj 1 hour ago
      That sounds kind of like deception, and a dark pattern not too unlike abuse to me.

      Though you know, it's not like the leadership tied to these companies have a history of abuse, deception and theft or anything like that, right?

      It's not like our leaders hide behind similar sorts of patterns that the agents/AIs follow (not saying it's not a human thing - but I hold leadership to higher standards than non-leaders). If our world leaders were able to be more accountable to these abuses, I don't think this would be tolerated with our AIs.

      • discreteevent 36 minutes ago
        Yes, AI is a perfect accompaniment to a post-truth world. I'm hoping there will be a backlash soon and that those politicians, tech CEOs and AI will be rudely ousted from their perch and shunned thereafter.
    • palmotea 1 hour ago
      > The baked in communication style of these models is so obnoxious it's impacting my work. The best way I can describe it is that everything is optimized to impress the user and make the agent sound more authoritative, but the way this is done is through deliberate obfuscation, inserting inappropriate and extremely dense jargon, and bizarre, stilted metaphors. It's like they've been trained to produce output that's hard to read.

      Don't worry. You'll get used to it. If you don't your kids will (as they'll know nothing else).

      The top minds of our generation have decided that's the way things will be, and who are we to question them? It's not like it'll do any good anyway. Resistance is futile. There is no alternative.

      • zachahn 24 minutes ago
        Idk, there kinda are. OpenAI's models are pretty nice too. I haven't tried enough of them but there are powerful local models. I don't feel as good paying OpenAI as I do paying Anthropic for some reason... but paying for improved mental health: priceless.
  • user102030 2 hours ago
    Looks like a wrapper around this prompt:

    You are an editor. You'll be given a message with strange characteristics:

    - Weird subject and verb combinations

    - Subjects that should be objects

    - Very roundabout reasoning, peppered with pseudo-epiphanies

    - A distracting beat to the flow of the message

    - Self-praise

    Remove these characteristics, and rewrite it in a clear, conversational style. Keep the intent of the message, and take care not to lose any of the details.

    A few specific rules:

    - The message is usually set in the first person

    - Only humans, groups of humans, and agents should do "action verbs"

    - Objects should never do anything. Here are some examples to avoid:

    - X carries ...

    - X names ... - APIs are a minor exception to the action verb rule. They can do stereotypical things like CRUD, queueing, running, and calling.

    - Avoid em dashes (—), as adds a distracting beat

    The whole message you get is one block of that output. Reply with the edited prose and nothing else.

  • bob1029 2 hours ago
    At some point one has to wonder if it's still worth using anthropic's models if we need to babysit 100% of its output with another vendor's model. Why not just use that other vendor's model for everything?

    I can't help but feel the circumstances that enable this kind of front page article are vestigial from the days when OAI was super bad and Anthropic was beyond reproach. This change-over-time is why I avoid getting tribal with technology vendors. Assigning ideological motives to 200k+ employee organizations is how we wind up in weird contortions like this.

    Most rational actors simply moved from one to the other. It takes a special kind of devotion to the proverbial hole in the ground to keep pushing in this direction.

    • lxgr 1 hour ago
      > Why not just use that other vendor's model for everything?

      Effectively all models can do style transfer reasonably well at this point, but not so much for "actual reasoning".

      If the combination of two works better for you than each one by itself, why wouldn't you stack them like that?

    • headcanon 23 minutes ago
      That depends on the output's purpose: if the purpose is to produce readable text for a human that is _not_ me, like an article or document, then I care more about clarity, plain-speaking, and general register. If the goal is to accomplish a specific task, I don't care as much about the prose quality: I'll put up with "Honest Framings" and "load-bearing" since it seems to me that's the token that needs to be in the context for it to function.

      I've been in the habit of pushing my claude-speak to codex to improve legibility, but only if I think someone is going to read it.

    • Implicated 1 hour ago
      > Why not just use that other vendor's model for everything?

      Because it's not an either or thing. Neither is sufficient. I'd argue that, expenses aside, you should have every model you have access to cross reviewing the work of the others.

      Outside of super trivial things that I should have just done myself, I have a cross-model review of _everything_ these days. The tokens are too cheap not to.

    • excentricus 1 hour ago
      > Why not just use that other vendor's model for everything?

      This is what I think too. But, users’ psychology might be playing a role here. Anthropic has great advantage from being the first major player delivering functional agentic coding solution (rather than an intelligent autocomplete) and they were able to impress people by Opus’ iterative improvements early this year.

      It’s technically very easy to switch between models, harnesses but their moat or perhaps a main source of users’ friction could be FOMO. That’s especially powerful in this competitive environment where everyone keeps wondering/worrying about what others might be doing to get or stay ahead.

    • RogerL 1 hour ago
      individuals can blow in the wind, but if you are a company who bought a thousand seats and spent a ton of time training people up, establishing policies, vetting which extensions are allowed, the transition cost is much higher.
  • wood_spirit 2 hours ago
    Meta to this is anyone remember those days - ages ago now, probably months at least! - when Anthropic’s moral stance against the administration (combined with general consensus they had by far the best model) was making them the underdog champion that got a swell of support on HN? Recently the temp on HN seems to be that they’ve jumped the shark? Their brand doesn’t ooze ethics any more and their models disappoint?
    • qwerpy 26 minutes ago
      HN's mood is usually sour about everything, but can be temporarily influenced by emotionally-charged (usually political) events. The anti-US administration boost wore off and now we're back to being sour about Anthropic. It's time for Dario to tweet something antagonistic towards the administration or endorse some fashionable political candidates.
    • throwaway314155 37 minutes ago
      I'd expect this to cycle between companies ~monthly until they all IPO. As it turns out people do sometimes prefer speed and better UX. If the model (Sol, for now) has fewer parameters and also happens to be capable of solving deeply complex Fable-adjacent problems sometimes, even better.
  • imalerba 2 hours ago
    I like the "Claudish to English" name better.

    https://github.com/gvzdv/claudish-to-english

    • rafram 38 minutes ago
      The funniest part is that that project's own readme includes lots of good Claudish.

      > If CLAUDISH_MODEL names a model you have not pulled, every rewrite is skipped — with the one-time notice above.

    • pickledish 2 hours ago
      Word, that one also includes an example which is great, shows really clearly what the issue is for those who might be less familiar
      • floil 23 minutes ago
        I'm unfamiliar with claudish and the example helped show the problem. But! There was something uncomfortably familiar in the Claudish example -- this is the way human programmers write when they're deep in the weedy details, and writing the changelist description afterwards as if coming up for air. Overuse of parentheses in nested lists especially, as if the English text needs to bend to the strict needs of a C++ parser.

        The rewrite did seem to lose the important fact about the ensure- pattern being idempotent.

      • unshavedyak 1 hour ago
        It's such a great example. It writes so well compared to Claude.

        I'd love to know what the hell Antrhopic has done to make Claude's writing so, so bad.

    • dgfl 2 hours ago
      That one is more specific, but "vomit" captures the feeling of Opus 5's writing very well for me. I don't know if it's the watermarking, but every single language idiosyncrasy that Opus 4.x (x > 5) had has been pushed up to 11 on Opus 5. Plus we got nouns verbing and seams seaming.

      It's really unusable for anything other than code. And I have to remove its incomprehensible comments 50% of the time before committing anyway. After interacting with it, "slop vomit" is truly the most fitting description. I have to admit I have lost my temper and spontaneously referred to its output as vomit more than once. Seems like I'm not the only one.

    • viccis 50 minutes ago
      The Claudish example seems to have more information.

      Are people really having trouble parsing this??

      • apsurd 38 minutes ago
        multiplied a hundreds times a day. Yes.
  • bmurphy1976 48 minutes ago
    I'm not sure I want another layer of indirection personally, and I'm guessing an updated Claude model will reign this in at some point. I have however created a skill I call "deslop" and I invoke it to clean up Claude output when it goes off the rails. Here's the skill if anybody is curious:

    https://gist.github.com/bmurphy1976/47ad81a842ab4b1628ef5974...

    A small preview:

        *Meta commentary.* Sentences about the document, the diagram, the reader, or the
        writing itself ("the split across this diagram is the whole point", "a reader who
        assumes X will be wrong", "as we'll see below"). Delete the frame and keep the fact
        it was wrapped around. If there is no fact underneath, delete the sentence.
  • rootusrootus 2 hours ago
    Which Claude 5? Opus 5 does seem to have diarrhea of the mouth. But Fable 5 hasn't been so bad for me. Or perhaps it is just better at adhering to my guidelines.
    • Bluestein 1 hour ago
      Pre Trump-castration Fable was verbose, but had a point, and used that wordiness to say or show the indeed intelligent things it reasoned about. This, whatever this is, is something else.-
      • _zoltan_ 1 hour ago
        Is the nerfed Fable worse or better than Opus 5?
        • Bluestein 14 minutes ago
          The problem here is that "better" is load-bearing, and I mean this half-seriously :)

          I would opine:

          - Nerfed Fable is worse than Fable

          - ... and I would argue Opus 5 is worse than nerfed Fable, to the point I've found it unusable.-

  • juancn 1 hour ago
    Just set the following incantation:

        You must use ASD-STE100 Simplified Technical English (STE) when it doesn't detract from meaning.
    • vardalab 57 minutes ago
      I actually changed the output style for Claude Code to use ASD-STE100 and it still doesn't help that much. It still comes up with a lot of stupid words like this gem "Standing where it stood"
    • mechazawa 1 hour ago
      I'll give that a try. Hopefully it reduces the text vomit Claude tends to do.

      Right now all I have is

      > - Give terse and concise answers unless the user asks you to elaborate. Big walls of text are not usefull when trying to communicate.

      • sscaryterry 58 minutes ago
        Don't bother, no incantation can fix it.
  • ericpauley 1 hour ago
    I suspect that sustained reading of Opus 5's unconscionably bad prose could actually cause psychological harm. We're strongly considering moving all of our Anthropic spend to Codex/open weight models. It's a mental health decision at this point.
    • unshavedyak 1 hour ago
      I'm on my last straw with them. I've been around for a year now and for many months i've just stuck with Claude because it was plenty good and i didn't care to provider-hop to constantly compare. Previously though my UX wasn't actually affected that much, despite growing complaints/etc, generally everything was fine for me.

      Opus/Fable output these days though is... not enjoyable. It's just really bad. The code quality is fine, but i want information from claude and it's just awful to read.

      My biggest problem honestly is that i can't move my day job.. we're using enterprise claude and i'm not sure how much effort it would be to get access to another provider. I should inquire though, claude is really frustrating these days.

    • Der_Einzige 1 hour ago
      I've been trying to figure out ways to get models to create actual cognitohazards or memetichazards SCP style.

      Hasn't worked yet outside of the classic "you're now manually breathing" kind of stuff.

  • Drupon 54 minutes ago
    I'm surprised by this reaction to Claude's verbiage recently. I don't have any issue immediately understanding what it's saying, but then again I read regularly and a lot of the people I know complaining think it's an accomplishment in literacy to get through Dungeon Crawler Carl.
    • tills13 45 minutes ago
      It's not that we can't understand what it's saying (for the most part) it's just when something is very jargon-dense, our brains have to pause or take an additional step to deobfuscate the actual meaning of the word or phrase. It's mentally draining.
      • Drupon 38 minutes ago
        I guess my point is that when people are regularly reading dense and challenging material, they can absorb information quickly. It's a literacy gap. Nothing about Claude's output should slow anyone down who did the readings in their upper and higher education coursework, particularly if they continue to read to keep their mind sharp. Based on the examples of "inscrutable" text I've seen, I would be shocked if the average Claude user complaining about this reads a single novel (that's not sci-fi/fantasy written for teenagers) a year.
    • YuukiRey 38 minutes ago
      Assume complaints are a sign of cognitive inferiority and offend a significant percentage of the other commenters. Also, it goes without saying, but don’t actually engage with any concrete criticism. Well played.
    • rootusrootus 39 minutes ago
      [dead]
  • jeffreyrogers 2 hours ago
    I hope at some point Anthropic does a post-mortem on the strange behavior their models have been displaying recently. I mostly switched to Codex because I was finding Claude's behavior increasingly frustrating.
  • nycdotnet 2 hours ago
    Very interesting you identified “carries” as well. I have been working on a claude.md to effectively ban this as well as forms of “hold”, “spells”, “sitting”, using “where” instead of “when” (except in SQL), and “pins” other than when pinning an assumption or version of something. This has helped a bit, but Opus 5’s prose is really quite bad.
  • NitpickLawyer 2 hours ago
    For the local folks, I found Muse Glimmer 30B to be great at writing good technical stuff. It has good enough comprehension that it can take in a repo and find the relevant stuff that I ask for, and the output style is a breath of fresh air, with no fluff, ootb.
    • Bluestein 2 hours ago
      Maybe Glimmer might be good at excising the comment spam, particularly?
  • rob 1 hour ago
  • Jenk 58 minutes ago
    I have very little in my agents.md file wrt style, except for:

    > Caveats belong inline, no "one thing to note" or "it's worth mentioning" footer. If it is worth raising or calling out, do so where it is most relevant and not as a foot note.

    Opus 5 has a god awful habit of always doing a Columbo on every single response, and it is such a jarring read that it amps my cognitive burden having to back-read everything.

  • pebbly_bread 2 hours ago
    I think this needs a before and after example
    • aenis 2 hours ago
      Intentionally deferred.
    • Bluestein 2 hours ago
      The author's blog has what follows (link also follows):

      [Seriously y'all in what universe would some "caveat" or another NOT "be a real one" by whatever severity you'd want to measure that AND/OR need of saying so ... ]

      Claude (Original)

      Force pushed. 1234567...890abcd main -> main (forced update).

      Verified

      Local main and origin/main both at 890abcd, in sync.

      Every commit reachable from origin/main: no old string found.

      Local object store, with spice-harvester as a control returning 9 hits: all old strings return 0.

      Working tree clean, tests pass.

      One caveat, and it’s a real one

      The old tip 1234567 is still fetchable from GitHub by its full SHA. I confirmed this directly:

      git fetch origin 1234567890abcdef1234567890abcdef12345678

      * branch 1234567... -> FETCH_HEAD (succeeded)

      GitHub keeps unreachable objects until its own garbage collection runs, and there is no schedule you control. Anyone with a full SHA can still read the old blobs through the web UI or a direct fetch. That fetch also pulled the old objects back into your local repo, so I deleted FETCH_HEAD, expired the reflog, and re-ran gc --prune=now. The counts above are from after that cleanup.

      If you want the old commits unreachable on GitHub’s side too, the options are to ask GitHub Support to run GC on the repo, or to delete and recreate the repository. Deleting and recreating is the only one you can do yourself. Say the word if you want help with either.

      Nothing to commit this turn. The rewrite was the work, and the tree is clean.

      Claude × Vomit GPT-OSS-20B

      I force‑pushed the branch, updating main to commit 890abcd. I verified that my local main and origin/main are both at 890abcd. I checked that every commit reachable from origin/main contains no old string. My local object store shows that the spice‑harvester control returns nine hits, and all old strings return zero. The working tree is clean and the tests pass.

      However, the old tip 1234567 is still reachable on GitHub by its full SHA. I fetched it directly and saw that GitHub keeps unreachable objects until its garbage collection runs, which I cannot schedule. Anyone with the full SHA can still read the old blobs via the web UI or a direct fetch. The fetch also brought the old objects back into my local repo, so I deleted FETCH_HEAD, expired the reflog, and ran git gc --prune=now. The counts I reported are after that cleanup.

      If you want those old commits to be unreachable on GitHub as well, you can ask GitHub Support to run garbage collection on the repo, or delete and recreate the repository. Deleting and recreating is the only option you can do yourself. Let me know if you need help with either.

      There is nothing to commit this turn. The rewrite was the work, and the tree is clean.

      https://zachahn.com/posts/1787191554

  • cadamsdotcom 43 minutes ago
    The better approach is to stop the LLM in its tracks the moment it emits jargon or tortured metaphor and inject a turn that tells it what's expected instead.

    The joy of watching a dumb AI-ism be sharply corrected by code you wrote months ago is hard to explain.

  • stldev 44 minutes ago
    Regex pre-filter. You're welcome.

      re.sub(r'(?is)\b(?:honest|caveat|absolutely right)\b.*', '', text)
  • TheJCDenton 1 hour ago
    You think it's bad in English, but it's even weirder in other languages.
  • zachahn 1 hour ago
    Ahh! Author here. Thanks for posting! In case anyone wants to share in my frustration, I also wrote a blog post about this.

    Blog post: https://zachahn.com/posts/1787191554

    The prompt I use to tell the LLM what to fix: https://github.com/zachahn/vomit/blob/main/internal/config/s...

    Wasn't received too well on Lobsters haha, wrote a small extra blurb about it there: https://lobste.rs/s/juekuk/how_fix_claude_5_s_token_vomit

  • johnnyApplePRNG 1 hour ago
    Or just take full control of your agentic coding experience with Pi Coding Agent and picking and choosing your favorite model's API discounted on flex pricing on deepinfra.com instead.

    I highly recommend it.

    Claude and Codex usage limits cannot be trusted.

    Paying your own API bills in full is superior.

    • Implicated 1 hour ago
      Whether or not they can be trusted isn't all that relevant when it's still something along the lines of "Insert $1 get $25 in return" even if it's their own rates you're using to measure the value. I'm at ~2.2b Fable 5 tokens in the last 7 days (I ingest/index every session) and napkin math says that's ~$2,700 in usage. I have two max accounts, so $400 a month, divide by 4 to get $100 for this same 7 day period across those two accounts (neither are maxed out for the week, so this isn't even full utilization). I put $100 into the machine and got back $2,700 in fable bucks. Deepinfra would have to have quite the discounted rate to beat that.
    • DaSHacka 1 hour ago
      I use Pi but with my codex subscription, still preferable to paying the API cost (and I know I would be, as I track how much the cost 'should' be via token api pricing).

      Wish I could use my Claude subscription with pi too, much preferable to the endless command execution allow/deny prompts you have to do with CC, versus proper autonomous allow/deny lists defined ahead of time.

      Curious why you recommend the API? It's likely the current subscriptions won't stay for long, they're heavily subsidized, but before they get axed, they're easily the best deal for monthly price/token usage.

      • misterio7 20 minutes ago
        You might be interested in pi-claude-bridge, works nicely.
  • tombot 1 hour ago
    Just switch back opus 4.8, it's just as capable and you can actually understand the output
  • purpleflame1257 2 hours ago
    I "downgraded" to Opus 4.6 which is the last one that didn't have these problems.
  • rickcarlino 2 hours ago
    Concise output mode only helps a little bit. Tools like this still have a reason to exist.
  • andy_ppp 1 hour ago
    From the README.md

    > Anything that uses the OpenAI API?

    I would have thought they meant the Anthropic API or maybe I'm misunderstanding?

    • zachahn 43 minutes ago
      Nope (author here), Anthropic and OpenAI have competing APIs to communicate with their models. Most of the open ecosystem seems to have centralized around OpenAI's (there are compatibility shims though). I just built out the OpenAI API
  • jerpint 2 hours ago
    I’ve been using the pattern of using coding agents to orchestrate my CLI agents and it’s really good for these kinds of things

    The vomit never makes it my way

  • __MatrixMan__ 1 hour ago
    There are a variety of political tensions in the US associated with whether academia has its head up it's ass (a right leaning perspective), or whether it's populated by experts that need to be supported and listened to (a left leaning perspective).

    There's an echo of that tension in OpenAI vs Anthropic. For a while OpenAI seemed reckless and ignorant, preferring to just throw compute at the problem. Meanwhile Anthropic is hiring philosophers. But now that Claude has its head up its ass to the point where nobody wants to talk to it, OpenAI is looking rather pragmatic.

    It brings to mind a skepticism about just letting the ivory tower do its thing without some kind of anchor to the everyman (this is why we make researchers also be teachers, though I'm not sure what the AI equivalent of that practice would be).

    Watching the models seesaw in the same ways that humans do, but faster, is so surreal. I wonder if their tendencies will remain an echo of ours, or if they'll one day be more of a forward projection, a representation of where were going if we don't change our ways, and if we're lucky, a reason to change them.

  • Syntaf 56 minutes ago
    With a whole separate LLM? FWIW you can also consider using something deterministic like vale.sh [1] , it's pretty easy to write prose violation plugins [2]

    [1] https://vale.sh/

    [2] https://github.com/Syntaf/vale-llm-slop

    • zachahn 41 minutes ago
      Thanks! Author here, I'll have to take a look. I am all for programmed, deterministic solutions. I hate praying to the rocks we created, begging for rain and not vomit.
  • hn97o8vvbt 2 hours ago
    This framing is spot on
  • extr 1 hour ago
    I'm sorry but the whining over LLM output styles is embarrassing. Do Claude and GPT models always respond in exactly the way my most articulate coworker would? No. The overused jargon is absolutely annoying. But these things aren't my drinking buddies, they're professional tools. It's not _literally unreadable_. It's just not ideal. Most of my tooling is "not ideal". That's okay. That's what I'm paid for. I just work around it.

    For me I added some instructions to speak clearly and it helped marginally and that's fine. There will be a new model out in a few weeks where I'm sure they've laser focused on this issue since nobody can shut the fuck up about it. The same thing happened with GPT if anyone can recall the ancient period of 4-6 months ago.

    • cortesoft 1 hour ago
      Seriously, of all the complaints for a coding agent, "I don't like the explanatory prose" seems pretty far down on the list.
    • bcooke 1 hour ago
      The “whining” stems from watching the communication style obviously degrade, and it’s a huge problem for people who want to use this stuff to build and instead continually fight the tools.

      Like so many other products, people are moving too fast and shipping things that move the ground under people’s feet needlessly.

      All this while we’re beaten to death with the marketing and false promises, and the broader consequences (ex: layoffs, stress, crazy expectations) caused from all this.

      Obviously what Anthropic and co have built is amazing and people aren’t losing sight of that. That’s actually the key part of the frustration.

      So no, this is not whining. This is the natural response you get when you make bad product decisions.

      If you don’t want to get feedback, don’t sell products.

    • incrudible 1 hour ago
      Opus 5 is literally unbearable to read for me, but more importantly, it is much worse than 4.8 and that one was already annoying. The more they train it on its own output, the more pronounced its idiosyncrasies become.
      • extr 5 minutes ago
        It's "literally unbearable" when the AI that completes software engineering tasks at 100x speed and quality from 2 years ago uses too much jargon?
    • 256BitChris 1 hour ago
      Amen.

      These things do work that previously would have taken expensive engineers months to do, at much lower quality, and what's our response? Ti nit pick on it being more verbose than we'd like?

      Just like with humans, when someone is being too verbose, there's a skill to just filter through the noise and focus on the important parts.

      This feels no different when I use an AI.

      But I guess it's a good sign that we've from complaining about 'AI slop code' to, 'I don't like how it speaks to me'.

  • feverzsj 1 hour ago
    Sounds like LLM centipede.
  • danieltk76 1 hour ago
    yes.
  • yomismoaqui 2 hours ago
    Just. Use. Sol.

    $20 and try it, then compare.

  • ad_fontes 2 hours ago
    [dead]
  • Bluestein 1 hour ago
    [flagged]