So is it just that these are people who haven’t personally experienced well-intentioned technology turning into a living nightmare? Watching the optimism and then collapse of Web 2.0 was a formative experience for me. I’m 38. Is this just naivete? What is this?
"Die Gedanken sind frei..." - can someone guess them? A truly dystopian question.
It is been 10 years when I looked at the research. Back then it was the problem to get enough good signal. Has the situation changed radically here for non-invasive electrodes or portable detectors? I have the feeling we are still in speculative territory in terms of product development.
Inevitablism, a fundamentalist belief system that resolves every moral hazard with an appeal to the inevitable. "we can't let someone else do this first"
I think this is actually marginally less evil than Meta Tribe. The whole neuro space is dangerous and while people go on about “AI safety” the world will trend towards this madness.
And this will provoke “well we need to regulate AI then”. No, you need to regulate poking around in people’s brains without asking them before that becomes normal.
it's in the article, around 2030 the device should be able to write and "make changes to the brain: hear audio, or tell the brain to use more calories" ...and later she envisions chatGPT becoming an extension of the brain like a sixth sense.
Yeah, this whole area of UX scares me. Silent speech techniques could strike a balance, but it seems obvious it wont stop there - consider what a state actor would do if they could skip interrogation altogether?
Unfortunately I think this is inevitable because as a species we perform a steady march toward collective desires for items of science fiction, so start your adversarial double-think practice now.
Is it really collective desire or are these products being pushed upon us? And why does it always have to be the dystopic "destroying human nature and society as we know it" science fiction and not the utopic "everyone lived happily ever after" science fiction? Or does it just feel that way to me?
who holds the copyright on the transcriptions of my thoughts read by this hardware? what license to those do you impose through EULA? what privacy controls need to be invented to prevent literal thought police?
Pretty sure that also involves tuning your motor control in your hand and arm. It's like thinking a download into your brain would make you a successful athlete.
I'd like to think that actually-existing-telepathy would be a more transformative technology than something that simply allows people to do their existing work more conveniently.
> It’s hard to collect enough data using invasive methods. Few people want a chip in their brain! But non-invasive methods are getting much better. The hardware is improving and getting cheaper, though I apologize for being vague about the particularities of our hardware.
> In a couple years, the main way we'll talk with our AIs is with our thoughts. They will not be a super-smart automated intern or coworker that you desperately try to keep up with. They will be a natural, joyful extension of you.
Ah, yes, very joyful indeed.
Also, fuck those interns! They're just too smart to keep up with.
Maybe I’m just demented but i feel like the first time I interface with chatgpt via telepathy it’s going to see my thoughts when the guy in the cube behind me farts or chews loudly, and send the FBI.
> My AI is a natural extension of me. It feels like a sixth sense and another limb. I wonder about a problem, feel as though I’m literally surfing the web, see glimpses of the websites, get flashes of intuition about the problem, and ultimately derive the answer. It feels fun! My brain is like the Flash. Because of write tech, my thinking is the fastest it's ever been even when I turn my AI off.
So is it just that these are people who haven’t personally experienced well-intentioned technology turning into a living nightmare? Watching the optimism and then collapse of Web 2.0 was a formative experience for me. I’m 38. Is this just naivete? What is this?
"Die Gedanken sind frei..." - can someone guess them? A truly dystopian question.
It is been 10 years when I looked at the research. Back then it was the problem to get enough good signal. Has the situation changed radically here for non-invasive electrodes or portable detectors? I have the feeling we are still in speculative territory in terms of product development.
Inevitablism, a fundamentalist belief system that resolves every moral hazard with an appeal to the inevitable. "we can't let someone else do this first"
Like Edward Teller wanting to develop hydrogen bombs while Oppenheimer was trying to prevent an arms race from starting.
"I will kill you now since you're dying anyway so just hand me all your money"
> Watching the optimism and then collapse of Web 2.0
What collapse of web 2.0?
Technically the website we're on is web 2.0 because we're interacting as users.
I don't think it's naiveté on their part to want to build new things. I think you're just jaded and hyperfocusing on the negatives.
To me, this reads as an attempt to raise easy investment money.
It's called being insulated from the immediate consequences of their actions and hubris.
I think this is actually marginally less evil than Meta Tribe. The whole neuro space is dangerous and while people go on about “AI safety” the world will trend towards this madness.
And this will provoke “well we need to regulate AI then”. No, you need to regulate poking around in people’s brains without asking them before that becomes normal.
well she is only 23 so naivete would make sense, although it looks like she held some AI safety roles so...
In the same way that “Anthropic” apparently means misanthropic, we can probably add “AI safety” to the list of newspeak.
Never mind "how could this go wrong". How could this go right?
Simple, think about going right
For some reason your comment reminded me of https://www.youtube.com/watch?v=ky-uzsw0kqw
Up and to the right, to be more specific. Transcend your one-dimensional thinking, Razengan.
> non-invasive
Dead in the water.
It's like an omlette. Can't make a neural interface worth a damn without cracking open a few skulls.
> Can't make a neural interface worth a damn without cracking open a few skulls.
I immediately thought, ironically, your neurology wrote that with a computer and HN humans' neurologies read it with computers.
From the article.
>Thought-to-text, aka telepathy
No, that's not telepathy. I'd leave the term alone. Consider it to be reserved for... well... telepathy!
I thought this was a parody when I opened it.
Probably more useful for interrogation than coding.
Under current US law, can people entering the US be subjected to mind-reading?
My thoughts being beamed to a frontier model where they are monetizable (and used for training) is terrifying.
They will also want to beam back the response straight back into your brain one day.
it's in the article, around 2030 the device should be able to write and "make changes to the brain: hear audio, or tell the brain to use more calories" ...and later she envisions chatGPT becoming an extension of the brain like a sixth sense.
The future is Borg.
No worries, I'm sure there won't be Flock cameras reading your thought crimes as you drive/walk by.
> My GPT-7 agent... I become .... annoyed at the AI-speak in its first paragraph
When we have GPT-7 it will still do AI-speak?!
Hmm...how do you stop private thoughts from reaching the LLM? Suddenly you can be prosecuted for thinking the "wrong" thoughts?
Yeah, this whole area of UX scares me. Silent speech techniques could strike a balance, but it seems obvious it wont stop there - consider what a state actor would do if they could skip interrogation altogether?
Unfortunately I think this is inevitable because as a species we perform a steady march toward collective desires for items of science fiction, so start your adversarial double-think practice now.
Is it really collective desire or are these products being pushed upon us? And why does it always have to be the dystopic "destroying human nature and society as we know it" science fiction and not the utopic "everyone lived happily ever after" science fiction? Or does it just feel that way to me?
"My AI just sent my boss a 12 paragraph screed because I thought about how much I hate him"
Visit from CIA in 3, 2, 1...
The only thing I would actually want this for would be a dream logger. Extremely invasive and quite dangerous otherwise.
There is probably good money in upgrading the polygraph security clearance ritual for the 21st century.
It doesn’t even really need to work of course.
As though we haven't done enough already to manipulate the mind, now we can have a neural model dictate our thoughts for us.
We can finally have ads in our dreams like Futurama.
- telepathic communication with your computer
- still annoyed by AI-speak
What a bold vision!
This is doomed to fail. Dry EEG electrodes basically only capture noise.
"In a couple years"
In a couple years?! Get over the technical hurdles, do you think PEOPLE will be ready to telepathically talk to a computer in A COUPLE OF YEARS?
Probably in our lifetime
https://youtu.be/jroQCyWwEgE
vim already exists
secret counterexample. people have been failing to learn vim for literal decades
Upon trying it for the first time more than 60% of people never exit - that's just great retention!
Every time I accidentally start vim, I just buy a new computer.
You mean 60% have still not discovered :q!
who holds the copyright on the transcriptions of my thoughts read by this hardware? what license to those do you impose through EULA? what privacy controls need to be invented to prevent literal thought police?
if you get an earworm you will have to pay royalties
You know how a microphone can also serve as a speaker?
Can this technology also do text to thought?
sure would be cool to transfer memories. Then we'd be able to download how to fly a helicopter.pdf right to our brains like in the matrix.
Pretty sure that also involves tuning your motor control in your hand and arm. It's like thinking a download into your brain would make you a successful athlete.
I'd like to think that actually-existing-telepathy would be a more transformative technology than something that simply allows people to do their existing work more conveniently.
If it doesn't work try thinking in Russian
are you specifically focused on non-invasive methods/why? seems like you reach a noise barrier which limits things like this
From the article
> It’s hard to collect enough data using invasive methods. Few people want a chip in their brain! But non-invasive methods are getting much better. The hardware is improving and getting cheaper, though I apologize for being vague about the particularities of our hardware.
> In a couple years, the main way we'll talk with our AIs is with our thoughts. They will not be a super-smart automated intern or coworker that you desperately try to keep up with. They will be a natural, joyful extension of you.
Ah, yes, very joyful indeed.
Also, fuck those interns! They're just too smart to keep up with.
I can't wait for this tech to be incorporated into corporate productivity trackers that seem to be getting more popular.
Maybe I’m just demented but i feel like the first time I interface with chatgpt via telepathy it’s going to see my thoughts when the guy in the cube behind me farts or chews loudly, and send the FBI.
What a terrible idea.
> My AI is a natural extension of me. It feels like a sixth sense and another limb. I wonder about a problem, feel as though I’m literally surfing the web, see glimpses of the websites, get flashes of intuition about the problem, and ultimately derive the answer. It feels fun! My brain is like the Flash. Because of write tech, my thinking is the fastest it's ever been even when I turn my AI off.
I read "race conditions" all over this vision.
exciting! you could imagine brain transcriptions being very high signal RLHF data that could help align models more deeply to human preference.
Thanks, I hate this.
I don't think I've ever been so viscerally revolted by the vision of a company.
Translation:
"I am a former-OpenAI employee and looking for investors to fund my AI startup."
Why I'm Leaving OpenAI to build the Torment Nexus
[dead]