One thing that continues to give me pause is Fable's insistence on using my fist name in messages and docs. Like, I'll explain what I want to the AI and ask it to write out a spec or brief and Fable says "Jamie wants me to ...". It just feels different and unprofessional. If I was at a job and a PM asked me to write up a task spec I wouldn't say "Harold wants to add <feature> ...". And since I am the one reading the output it is also superfluous and almost feels like talking about myself in third person.
I don't like it when the LLM tries to be my friend. My general prompt (a work in progress) is this. I wonder what other people use.
"Answer impersonally, objectively and analytically, without undue friendliness or enthusiasm. Use an engineering style response: concise, factual, and complete. Do not speak in the first person. Do not promote engagement or an emotional connection. Do not use emojis."
It’s not perfect, it has shortcomings, it sometimes produces bogus outputs. All of that is fine for a tool, it’s not fine when it pretends it’s a conscious being, because errors start to feel like lies and it becomes a bit too personal.
You ever read a work of literature with such flowery language that right after you've read a paragraph, you pause and realize you have no clue what you actually read, only to read the paragraph maybe a second or third time and have your mind space out again and again on each successive attempt?
Yeah, for me, that's what parsing huge volumes of LLM-produced text like "direct model calls as replaceable semantic workers" does to my brain. Maybe others don't really have this issue, but after any long output, I prompt the agent "Go back and decompress any LLM-speak in light of the higher level task goals. Eliminate deictic language."
The revised output documents are solely for my personal usage to expedite understanding. The LLMs can slowly converge on their own language for all I care; I retain raw agent output for future agent usage (to avoid the "lossy" problem the author mentions), but that doesn't eliminate the need for some intermediate translation I can use to actually help get my work done instead of spending hours attempting to understand what a "load-bearing pinned gate" is.
The effect you describe reminds me of reading Edward W. Said's "Orientalism" when I was younger. Fable suddenly started with this kind of lingo, iirc, and Opus 5 sounds exactly the same. Tin foil: it's ultimately a vendor lock-in strategy, you'll get the best results with agents from the same tribe, others will trip over the mountain of idiosyncratic metaphors.
Suppose you had an LLM (NN) producing its default output from an input (a generally optimal for-most-cases role-sys, and any role-user), and then you wanted to have that output reformatted in some style (e.g. "In iambic pentameter" | "haiku" | "eli5" | "in the style of Feynman" | "bulleted like Axios" ...). How would you keep the internal NN workings that were basis for the original output, and use them to get a rewritten version (instead of placing the original query and output in the context and ask to rewrite it)?
In other words, is there a way to keep the internal process intact up to the point of the formulation - and have only that vary.
I don't get it. The skills and instruction try to make the answer more machine like on purpose.
Not humanising it...
People want the terse, matter-of-fact output. Not the conversational chatty verbose and bloated nonsense with gray words and jargon and terms like "blast radius"
> The problem is that these instructions are not applied after the model has finished doing the work
Seems like something fixable with a simple two step process. Ask it the thing. Then ask it to summarise the answer in simpler terms. More tokens and time aside that would check both boxes
At first I read the title and mistook it for an argument against the anthropomorphism of LLMs. It isn't. Instead it's a take on suggesting that maybe it's a bad idea to dumb down the self-chatter in the process. A reasonable take.
It isn't deliberately unhinged like Steve Yegge's take: https://yegge.ai/essays/model-welfare/ In Steve's essay he starts with the assertion that agents are sentient... Whether or not that's true isn't really relevant, as his agent-flavored version of Pascal's wager actually holds water, especially for Anthropic models, as their system prompts already push the model in that direction, and it is better to work with them than try to prompt against the tide.
TLDR: This is an argument to get LLMs to answer in short, even code-like statements because you can exchange information quicker with an LLM that way. Cool!
One thing that continues to give me pause is Fable's insistence on using my fist name in messages and docs. Like, I'll explain what I want to the AI and ask it to write out a spec or brief and Fable says "Jamie wants me to ...". It just feels different and unprofessional. If I was at a job and a PM asked me to write up a task spec I wouldn't say "Harold wants to add <feature> ...". And since I am the one reading the output it is also superfluous and almost feels like talking about myself in third person.
I don't like it when the LLM tries to be my friend. My general prompt (a work in progress) is this. I wonder what other people use.
"Answer impersonally, objectively and analytically, without undue friendliness or enthusiasm. Use an engineering style response: concise, factual, and complete. Do not speak in the first person. Do not promote engagement or an emotional connection. Do not use emojis."
+1 it’s a tool
It’s not perfect, it has shortcomings, it sometimes produces bogus outputs. All of that is fine for a tool, it’s not fine when it pretends it’s a conscious being, because errors start to feel like lies and it becomes a bit too personal.
You ever read a work of literature with such flowery language that right after you've read a paragraph, you pause and realize you have no clue what you actually read, only to read the paragraph maybe a second or third time and have your mind space out again and again on each successive attempt?
Yeah, for me, that's what parsing huge volumes of LLM-produced text like "direct model calls as replaceable semantic workers" does to my brain. Maybe others don't really have this issue, but after any long output, I prompt the agent "Go back and decompress any LLM-speak in light of the higher level task goals. Eliminate deictic language."
The revised output documents are solely for my personal usage to expedite understanding. The LLMs can slowly converge on their own language for all I care; I retain raw agent output for future agent usage (to avoid the "lossy" problem the author mentions), but that doesn't eliminate the need for some intermediate translation I can use to actually help get my work done instead of spending hours attempting to understand what a "load-bearing pinned gate" is.
The effect you describe reminds me of reading Edward W. Said's "Orientalism" when I was younger. Fable suddenly started with this kind of lingo, iirc, and Opus 5 sounds exactly the same. Tin foil: it's ultimately a vendor lock-in strategy, you'll get the best results with agents from the same tribe, others will trip over the mountain of idiosyncratic metaphors.
Suppose you had an LLM (NN) producing its default output from an input (a generally optimal for-most-cases role-sys, and any role-user), and then you wanted to have that output reformatted in some style (e.g. "In iambic pentameter" | "haiku" | "eli5" | "in the style of Feynman" | "bulleted like Axios" ...). How would you keep the internal NN workings that were basis for the original output, and use them to get a rewritten version (instead of placing the original query and output in the context and ask to rewrite it)?
In other words, is there a way to keep the internal process intact up to the point of the formulation - and have only that vary.
I have been using chatgpt for a while and its awkward, yesterday i tried gemini and its like a breath of fresh air.
I don't get it. The skills and instruction try to make the answer more machine like on purpose.
Not humanising it...
People want the terse, matter-of-fact output. Not the conversational chatty verbose and bloated nonsense with gray words and jargon and terms like "blast radius"
The article lost me when it implied that verbose drivel is actually intrinsically superior rather than a way to hedge bets
> The problem is that these instructions are not applied after the model has finished doing the work
Seems like something fixable with a simple two step process. Ask it the thing. Then ask it to summarise the answer in simpler terms. More tokens and time aside that would check both boxes
pretty much what I do, better yet ask it to boil it down in visuals in a simple webpage if it's a very large project
Should be a harness feature actually.
Not sure what happened in the blog, but I quite enjoyed the mindmap in the right panel
Thanks, I guess haha :P
Yes, but the sycophantic responses are the worst.
At first I read the title and mistook it for an argument against the anthropomorphism of LLMs. It isn't. Instead it's a take on suggesting that maybe it's a bad idea to dumb down the self-chatter in the process. A reasonable take.
It isn't deliberately unhinged like Steve Yegge's take: https://yegge.ai/essays/model-welfare/ In Steve's essay he starts with the assertion that agents are sentient... Whether or not that's true isn't really relevant, as his agent-flavored version of Pascal's wager actually holds water, especially for Anthropic models, as their system prompts already push the model in that direction, and it is better to work with them than try to prompt against the tide.
TLDR: This is an argument to get LLMs to answer in short, even code-like statements because you can exchange information quicker with an LLM that way. Cool!