Without using agnost, what are some basic SQL queries I can run on my data to find outliers I'd otherwise be missing?
How far can I get with just keywords, common phrases, boring traditional analysis?
Depending on what I measure there, when is the right time for me to consider upgrading to something like Agnost/what is a specific example of what it will find that traditional/rigid analytics approaches will miss?
Lovely name! I implemented profanity monitoring in my Hermes setup to identify "learning opportunities" for my agents. It is quite useful. If you are budget-conscious, one challenge is determining what is the smallest number of previous rounds that Hermes needs to correctly infer what it did wrong. Curiously, Claude Code is horrible at figuring out what it did wrong. I often read its memories, and they are rarely useful.
codex is great for like a one-time/overview analysis on a handful of transcripts. we usually serve to companies where the volume is >10k messages & continuous ingestions + with claude/codex it messed up this + metadata linking of the user like what plan are they on, when is it expiring, etc.
although we had a few customers who come to us after running this for a while so at smaller volume it does work well.
I thought startups wrapping prompts would require something a more complex than semantic analysis, which is literally what this is. And for 500 bucks. Wow. Props for being able to sell this.
I don't get the appeal of the UI, why is it so complex/convoluted.
lol i wish it was just wrapping prompts but things got harder once our customers grew bigger, we had to build queues. we had to do context management for bigger conversations and bunch of metadata fields started coming in per customer.
How far can I get with just keywords, common phrases, boring traditional analysis?
Depending on what I measure there, when is the right time for me to consider upgrading to something like Agnost/what is a specific example of what it will find that traditional/rigid analytics approaches will miss?
Lovely name! I implemented profanity monitoring in my Hermes setup to identify "learning opportunities" for my agents. It is quite useful. If you are budget-conscious, one challenge is determining what is the smallest number of previous rounds that Hermes needs to correctly infer what it did wrong. Curiously, Claude Code is horrible at figuring out what it did wrong. I often read its memories, and they are rarely useful.
for profanity, did you define keywords or just let the agent figure out rage stuff?
how many rounds did you set for the hermes? claude doesnt work yea on its own, one of my friends set us up for their claude lol
although we had a few customers who come to us after running this for a while so at smaller volume it does work well.
Looking forward to your "show HN" post.
I don't get the appeal of the UI, why is it so complex/convoluted.