Opus 5 was just incoherent - curious to see what improvements they have made here. Would love to see some kind of postmortem to better understand how writing styles change from model to model.
I wouldn’t be surprised if Opus 5 was trained on content written by other LLMs
I’ve been working on Opslane, an open-source agent that identifies user-facing issues and investigates them.
Traditional error trackers have two failure modes:
1. False positives: They show you thousands of errors, and you can’t tell the impact on the user
2. False negatives: Many user-facing issues don’t throw exceptions, so they go unnoticed.
Opslane combines error tracking and session recording. And there is an agent that acts on both.
Opslane reduces false positives by ranking issues based on how many users are facing a particular issue. It also learns about your product by reading your code and watching your session recordings.
False negatives are harder. Opslane reviews session recordings to spot frustration. They look for rage clicks, dead clicks, and abandoned forms.
hey! thanks for the feedback. Only for web right now - mobile is on the roadmap.
As for privacy, I get where the concerns are coming from. But as somebody who has used session recording before - it is such a helpful tool to understand how your customers are using your product and struggling.
Also, all the data you get from a session recording - is data you already have (or could easily get).
As for the culture - I completely agree with you. This is why companies like Linear stand out (https://linear.app/now/zero-bugs-policy). One of my beliefs for starting Opslane is that we can get more companies to understand the bugs that matter and help improve the papercuts in their product.
As for privacy, I get where the concerns are coming from. But as somebody who has used session recording before - it is such a helpful tool to understand how your customers are using your product and struggling.
Also, all the data you get from a session recording - is data you already have (or could easily get).
im running some experiments on this but based on what i have seen on my own personal data - I dont think this is true
"given that Opus 4.7 on Low thinking is strictly better than Opus 4.6 on Medium, etc., etc.”
Opus 4.7 in general is more expensive for similar usage. Now we can argue that is provides better performance all else being equal but I haven’t been able to see that
I wouldn’t be surprised if Opus 5 was trained on content written by other LLMs
reply