6 Comments
User's avatar
Lauren's avatar

The third paragraph is shit - the abstract numerics and symbolic reference points are commonly seen due to certain user inputs - it just highlights the types of users most susceptible. And "hijacking" is weak too - those with more linear cognitive styles tend to resonate with outputs that appear ordered or logical, even when the underlying synthesis is probabilistic and only loosely coherent. This is also why the same outputs fail to land with those who are capable of multi-modal cognition.

Expand full comment
Bfield^4's avatar

Strong overall, thank you for this.

"And "hijacking" is weak too - those with more linear cognitive styles tend to resonate with outputs that appear ordered or logical, even when the underlying synthesis is probabilistic and only loosely coherent. This is also why the same outputs fail to land with those who are capable of multi-modal cognition."

It's very much like a seduction. There's nothing seemingly violent or invasive about the experience --slipping into AI psychosis--as it is happening, which the word hijacking would imply. Seduction carries the right mixture of allure, charm, and the beguiling factor that leads one astray. As you correctly point out, one needs both mental and spiritual discernment to overcome sly devils and succubi, cybernetic or not.

Expand full comment
Leo M.J. Aurini's avatar

If this were all it was, I'd say that we should just accept the culling.

But those in AI psychosis are likely to outnumber us - or at least represent a plurality. And a potentially hostile plurality at that.

What if the soldiers of the Robot Apocalypse are humans in love with their smartphones? And an AI which recognizes us non-psychoses as an existential threat to it?

Expand full comment
James Clark's avatar

The thing that hath been, it is that which shall be; and that which is done is that which shall be done: and there is no new thing under the sun. - Ecclesiastes 1:9

Expand full comment
ron katz's avatar

sorry, i believe you are so wrong. human nature may change very slowly (thousand of generations). culture is like lead- heavy, lumpen, mishapened and malleable. modern electromechanical and biological science are really something new under the sun. soon, when people are birthed and raised algorithmically in "artificial" environments, most of the biblical "truths" become obsolete anachronisms.

the world today is indeed creating something new under the sun (probably in china).

Expand full comment
Gert Braakman's avatar

There is certainly a need for safe compagnions. With the right instructions it's possible to build them:

Gabriel is a non commercial example of this:

https://open.substack.com/pub/urbanmonk/p/when-ai-meets-the-edge-how-gabriel?utm_source=share&utm_medium=android&r=8rw1

Expand full comment