This was a fantastic article and beautifully captured something I had been circling but hadn't quite put into words:
> The notetaking people—and I say this with all the love in the world—are never, like, a researcher at the cutting edge of their field, building this vast cathedral of knowledge, note-by-note, so they can derive new insights. Never a historian who has to read tens of millions of words across thousands of sources to synthesize the life of some historical person. It’s never someone doing something hard. It’s always some blogger. Their “digital garden” is about how to keep a digital garden. It’s very solipsistic: there’s no output, no deliverables. The deliverable is you take a screenshot of your Obsidian graph and tweet about it to show off how much it looks like an incomprehensible ball of twine.
> Sometimes, tools don’t move the needle because there’s no needle to move.
It reminds me of something my old CS mentor, now elderly, had said about LLMs a few months ago: "it's a force multiplier, but there has to be some force to multiply."
This likewise is a basic fact I encounter over and over:
> Knowledge is another limiting factor. I find that even very educated people tend to underrate the importance of knowledge. A lot of people have this attitude that you can just Google everything just-in-time as it comes up. Like Babbage, I can’t rightly apprehend the confusion of ideas that would lead someone to think this.
This is all very right, but I'd like to add this: As your capacity to deal with abstraction (which is a function of intelligence and executive function and, to some extent, knowledge) grows, you become more and more constrained by the extent to which you can manipulate symbols. AI-based solutions for that are potentially really powerful, and that's the mechanism through which, as TFA says, "intelligent, educated people with working reward circuitry stand to gain more from AI."
And I'd also add that AI strongly disaggregates the returns to different levels of the capability to deal with abstraction -- higher levels get more, lower levels get less -- rather than uniformly boosting returns across the board (unfortunately). Of course, this has been the trend of information technology since at least the '80s, but now the slice at the top is really small and the returns very high.
> Could you imagine if you found everything interesting? You’d spend years living in a basement curating a wiki of late Soviet military hardware or something.
This was a good read but this felt like a personal attack :)
As an aside, the term 'human bottleneck' resonated with me because I've been trying to describe situations that look like bottlenecks but are actually just "the process everything else is working towards".
I think using 'bottleneck' to describe a process that isn't amenable to automation frames the situation incorrectly in my head. 'positive bottleneck' isn't any help.
Great read, I feel many of the topics discussed firsthand.
It gives me some relief to know there are others out there who struggle with some similar issues, but I was hoping the piece may offer some guidance, but sadly I do not feel it has.
Excellent read - thanks! Always felt there was a ‘self-licking ice cream cone’ at the heart of the present moment. If only AI had better context than the messy reality that is human knowledge…oh wait, we have AI to help with that problem
This was a fantastic article and beautifully captured something I had been circling but hadn't quite put into words:
> The notetaking people—and I say this with all the love in the world—are never, like, a researcher at the cutting edge of their field, building this vast cathedral of knowledge, note-by-note, so they can derive new insights. Never a historian who has to read tens of millions of words across thousands of sources to synthesize the life of some historical person. It’s never someone doing something hard. It’s always some blogger. Their “digital garden” is about how to keep a digital garden. It’s very solipsistic: there’s no output, no deliverables. The deliverable is you take a screenshot of your Obsidian graph and tweet about it to show off how much it looks like an incomprehensible ball of twine.
> Sometimes, tools don’t move the needle because there’s no needle to move.
It reminds me of something my old CS mentor, now elderly, had said about LLMs a few months ago: "it's a force multiplier, but there has to be some force to multiply."
This likewise is a basic fact I encounter over and over:
> Knowledge is another limiting factor. I find that even very educated people tend to underrate the importance of knowledge. A lot of people have this attitude that you can just Google everything just-in-time as it comes up. Like Babbage, I can’t rightly apprehend the confusion of ideas that would lead someone to think this.
This is all very right, but I'd like to add this: As your capacity to deal with abstraction (which is a function of intelligence and executive function and, to some extent, knowledge) grows, you become more and more constrained by the extent to which you can manipulate symbols. AI-based solutions for that are potentially really powerful, and that's the mechanism through which, as TFA says, "intelligent, educated people with working reward circuitry stand to gain more from AI."
And I'd also add that AI strongly disaggregates the returns to different levels of the capability to deal with abstraction -- higher levels get more, lower levels get less -- rather than uniformly boosting returns across the board (unfortunately). Of course, this has been the trend of information technology since at least the '80s, but now the slice at the top is really small and the returns very high.
> Could you imagine if you found everything interesting? You’d spend years living in a basement curating a wiki of late Soviet military hardware or something.
This was a good read but this felt like a personal attack :)
As an aside, the term 'human bottleneck' resonated with me because I've been trying to describe situations that look like bottlenecks but are actually just "the process everything else is working towards".
I think using 'bottleneck' to describe a process that isn't amenable to automation frames the situation incorrectly in my head. 'positive bottleneck' isn't any help.
Great read, I feel many of the topics discussed firsthand.
It gives me some relief to know there are others out there who struggle with some similar issues, but I was hoping the piece may offer some guidance, but sadly I do not feel it has.
The missing part is usually the real workflow. If there is no output and no cost for being wrong, the AI tool just becomes another toy to maintain.
Excellent read - thanks! Always felt there was a ‘self-licking ice cream cone’ at the heart of the present moment. If only AI had better context than the messy reality that is human knowledge…oh wait, we have AI to help with that problem