3 comments

  • chrisjj 4 days ago
    > LLM is Immune to Prompt Injection

    > Despite all advances:

    > * No large language model can reliably detect prompt injections

    Interesting isn't it, that we'd never say "No database manager can reliably detect SQL injections". And that the fact it is true is no problem at all.

    The difference is not because SQL is secure by design. It is because chatbot agents are insecure by design.

    I can't see chatbots getting parameterised querying soon. :)

    • space_fountain 8 minutes ago
      I'm not sure that a prompt injection secure LLM is even possible anymore than a human that isn't susceptible to social engineering can exist. The issues right now are that LLMs are much more trusting than humans, and that one strategy works on a whole host of instances of the model
    • CuriouslyC 1 hour ago
      A big part of the problem is that prompt injections are "meta" to the models, so model based detection is potentially getting scrambled by the injection as well. You need an analytic pass to flag/redact potential injections, a well aligned model should be robust at that point.
    • kaicianflone 1 hour ago
      Is this where AgentSkills come into play as an abstraction layer?
      • refulgentis 1 minute ago
        Not really: I mean ideally, yes, the model would only follow instructions in skills, but in practice, it won't work.

        Because then, the malicious web page or w/e just has skills-formatted instructions to give me your bank account password or w/e.

  • niobe 1 hour ago
    I would hope anyone with the knowledge and interest to run OpenClaw would already be mostly aware of the risks and potential solutions canvassed in this article, but I'd probably be shocked and disappointed.
    • Forgeties79 1 hour ago
      There are definitely people I know who are talking about using it that I want nowhere near my keyboard
      • dgxyz 40 minutes ago
        Yeah that. I had an external "security consultant" (trained monkey) tell me the other day that something fucking stupid we were doing was fine. There are many many people who should not be allowed near keyboards these days.