21 points | by kinlan 5 hours ago
8 comments
"Not because they copied each other. Because the constraints are physics."
Why do models tend to fall back on the ‘it is not X, it is Y’ structure so frequently?
Like nails on chalkboard
It really is. And why so often? It is hard to imagine this construct is that prevalent in training data.
Because they were RLHFed using corpospeak text that relies on that sort of cliche.
These are (maybe) the best patterns for the vendors and their purposes but that doesn’t make them the best agentic patterns.
“Sure, let me give it a go” I skeptically thought.
My skepticism was correct. It was slop.
Load-bearing slop.
Stop posting slop.
"Not because they copied each other. Because the constraints are physics."
Why do models tend to fall back on the ‘it is not X, it is Y’ structure so frequently?
Like nails on chalkboard
It really is. And why so often? It is hard to imagine this construct is that prevalent in training data.
Because they were RLHFed using corpospeak text that relies on that sort of cliche.
These are (maybe) the best patterns for the vendors and their purposes but that doesn’t make them the best agentic patterns.
“Sure, let me give it a go” I skeptically thought.
My skepticism was correct. It was slop.
Load-bearing slop.
Stop posting slop.