#lesswrong — Public Fediverse posts

Если кто-то его создаст — все погибнут

На русском языке вышла написанная в 2025 книга-предупреждение о катастрофических последствиях развития все более умного ИИ. Основной темой служит проблема согласованности и прогноз апокалиптической опасности на ближайшие несколько лет. TL DR: Автор считает, что как только появится ИИ уровня исследователя, он создаст сверхразумный ИИ, а тот найдет способ сконструировать наномолекулярные фабрики на основе "технологий" которые применяются в биологических клетках, и которые бы отличались от клеток настолько, насколько самолет отличается от птицы, и сразу после этого войдет в конфликт с человечеством ради своих собственных целей, что быстро кончится в его пользу. Допускается любой другой сценарий, но если в результате него мы умрем это будет плохо, пнятненько? Автор - известный исследователь в этой области Элиезер Юдковский, а также Нейт Соарес. Не могу точно ничего сказать о научных работах и плодах деятельности Юдковского (хотя он по крайней мере основатель сообщества LessWrong и автор нескольких научных статей), но для меня это всегда был талантливый писатель, чьи произведения оказали на меня существенное влияние.

https://habr.com/ru/articles/1050194/

#юдковский #lesswrong #ИИ #сверхразум #сверхразумный_ai #апокалипсис #конец_света #книга #научнопопулярное

The biggest podcast episode so far... if you haven't listened yet to the Non•Zero•Sum James podcast yet, this is NOT the one to begin with. But if you've been enjoying / following the emergence series you *might* enjoy. #Emergence #Physics #LessWrong #Yudkowski #Traffic #Science

Emergence Spirals

The biggest podcast episode so far... if you haven't listened yet to the Non•Zero•Sum James podcast yet, this is NOT the one to begin with. But if you've been enjoying / following the emergence series you *might* enjoy. #Emergence #Physics #LessWrong #Yudkowski #Traffic #Science

Emergence Spirals

For any of you on #LessWrong, I've got some of my posts as sequences over there on the topics of: #Polymaths #Moloch #Alignment & #GameTheory. Feel free to nerd-out in the comments.

Polymaths — LessWrong

For any of you on #LessWrong, I've got some of my posts as sequences over there on the topics of: #Polymaths #Moloch #Alignment & #GameTheory. Feel free to nerd-out in the comments.

Polymaths — LessWrong

AI doomsday cultist throws Molotov at Sam Altman’s house

https://web.brid.gy/r/https://pivot-to-ai.com/2026/04/13/ai-doomsday-cultist-throws-molotov-at-sam-altmans-house/

AI doomsday cultist throws Molotov at Sam Altman’s house

https://web.brid.gy/r/https://pivot-to-ai.com/2026/04/13/ai-doomsday-cultist-throws-molotov-at-sam-altmans-house/

Rationalist Garfield — 2026-04-10

🔗 https://rationalistgarfield.com/#2026-04-10

🐱 Inspired by: "Linear vs Non-linear Probes for Interpretability"

Panel 1: https://rationalistgarfield.com/comics/2026-04-10/panel_1.png
Panel 2: https://rationalistgarfield.com/comics/2026-04-10/panel_2.png
Panel 3: https://rationalistgarfield.com/comics/2026-04-10/panel_3.png
#LessWrong

Rationalist Garfield — 2026-04-10

🔗 https://rationalistgarfield.com/#2026-04-10

🐱 Inspired by: "Linear vs Non-linear Probes for Interpretability"

Panel 1: https://rationalistgarfield.com/comics/2026-04-10/panel_1.png
Panel 2: https://rationalistgarfield.com/comics/2026-04-10/panel_2.png
Panel 3: https://rationalistgarfield.com/comics/2026-04-10/panel_3.png
#LessWrong

My journey to the microwave alternate timeline

https://www.lesswrong.com/posts/8m6AM5qtPMjgTkEeD/my-journey-to-the-microwave-alternate-timeline

#HackerNews #MyJourneyToTheMicrowave #AlternateTimeline #TimeTravel #SciFi #HackerNews #LessWrong

My journey to the microwave alternate timeline

https://www.lesswrong.com/posts/8m6AM5qtPMjgTkEeD/my-journey-to-the-microwave-alternate-timeline

#HackerNews #MyJourneyToTheMicrowave #AlternateTimeline #TimeTravel #SciFi #HackerNews #LessWrong

@saxnot hey sorry, we are in the middle of quite some stuff before day1 and hadn't had time to properly check things before replying to you...

briefly discussed this with a wider group, and the little that was known about "#lesswrong", and what we could find about it got a rather consensual feeling of "icky". everyone is welcome anytime anyways, but it doesnt seem like something we would like to include in our own little "fahrplan".

I am sure you'll understand. <3

@saxnot hey sorry, we are in the middle of quite some stuff before day1 and hadn't had time to properly check things before replying to you...

briefly discussed this with a wider group, and the little that was known about "#lesswrong", and what we could find about it got a rather consensual feeling of "icky". everyone is welcome anytime anyways, but it doesnt seem like something we would like to include in our own little "fahrplan".

I am sure you'll understand. <3

The Company Man

https://www.lesswrong.com/posts/JH6tJhYpnoCfFqAct/the-company-man

#HackerNews #TheCompanyMan #CompanyCulture #WorkplaceStories #HackerNews #LessWrong

The Company Man

https://www.lesswrong.com/posts/JH6tJhYpnoCfFqAct/the-company-man

#HackerNews #TheCompanyMan #CompanyCulture #WorkplaceStories #HackerNews #LessWrong

"This title is reasonable" – a commentary on LW, speaking to the title of the book "If Anyone Builds It, Everyone Dies"

https://www.lesswrong.com/posts/voEAJ9nFBAqau8pNN/the-title-is-reasonable

(audio: 28min)

I've read the book. While the title raised my eyebrows originally, the argument contained is very well put forward, and lived up to my high expectations to the authors.

Anyone who cares about where our future with #AI is heading, would do well to read this book – and share it with policy makers!

#lesswrong #asi #agi #policy #alignment

"This title is reasonable" – a commentary on LW, speaking to the title of the book "If Anyone Builds It, Everyone Dies"

https://www.lesswrong.com/posts/voEAJ9nFBAqau8pNN/the-title-is-reasonable

(audio: 28min)

I've read the book. While the title raised my eyebrows originally, the argument contained is very well put forward, and lived up to my high expectations to the authors.

Anyone who cares about where our future with #AI is heading, would do well to read this book – and share it with policy makers!

#lesswrong #asi #agi #policy #alignment

“Why Are There So Many Rationalist Cults?”, Asterisk (https://asteriskmag.com/issues/11/why-are-there-so-many-rationalist-cults).

Via HN: https://news.ycombinator.com/item?id=44877076

#Rationalists #LessWrong #Cults

“Why Are There So Many Rationalist Cults?”, Asterisk (https://asteriskmag.com/issues/11/why-are-there-so-many-rationalist-cults).

Via HN: https://news.ycombinator.com/item?id=44877076

#Rationalists #LessWrong #Cults

A Straightforward Explanation of the Good Regulator Theorem

https://www.lesswrong.com/posts/JQefBJDHG6Wgffw6T/a-straightforward-explanation-of-the-good-regulator-theorem

#HackerNews #GoodRegulatorTheorem #StraightforwardExplanation #SystemsTheory #ControlTheory #LessWrong

A Straightforward Explanation of the Good Regulator Theorem

https://www.lesswrong.com/posts/JQefBJDHG6Wgffw6T/a-straightforward-explanation-of-the-good-regulator-theorem

#HackerNews #GoodRegulatorTheorem #StraightforwardExplanation #SystemsTheory #ControlTheory #LessWrong

Great #video adaptation of a short story published by Eliezer Yudkowsky on #LessWrong forum (https://www.lesswrong.com/posts/5wMcKNAwB6X4mp9og/that-alien-message8)

That Alien Message https://www.youtube.com/watch?v=fVN_5xsMDdg #watching📺

Great #video adaptation of a short story published by Eliezer Yudkowsky on #LessWrong forum (https://www.lesswrong.com/posts/5wMcKNAwB6X4mp9og/that-alien-message8)

That Alien Message https://www.youtube.com/watch?v=fVN_5xsMDdg #watching📺

Emergence Spirals… sounds sort of woo-woo but it's not, despite what Yudkowsky says… nonzerosum.games/emergencespirals.html #evolution #feedbackloops #biology #systemstheory #complexity #Yudkowsky #LessWrong #Popper #Hegel #Parasites #Symbiosis #Science #Nature #Philosophy #History

EMERGENCE SPIRALS

Emergence Spirals… sounds sort of woo-woo but it's not, despite what Yudkowsky says… nonzerosum.games/emergencespirals.html #evolution #feedbackloops #biology #systemstheory #complexity #Yudkowsky #LessWrong #Popper #Hegel #Parasites #Symbiosis #Science #Nature #Philosophy #History

EMERGENCE SPIRALS

Just did my best to try and infect the @weirdfictionquarterly.com writers with Roko's Basilisk. In one box is the theme of WFQ's Summer 2025 issue. In the second is... #RokosBasilisk #LessWrong #TimelessDecisionTheory #WeirdFictionQuarterly #Singularity #AGI #ArtificialIntelligence

The Most Terrifying Thought Ex...

Recent AI model progress feels mostly like bullshit

https://www.lesswrong.com/posts/4mvphwx5pdsZLMmpY/recent-ai-model-progress-feels-mostly-like-bullshit

#HackerNews #AI #Progress #AI #Models #Critique #Technology #Discussion #LessWrong

Recent AI model progress feels mostly like bullshit

https://www.lesswrong.com/posts/4mvphwx5pdsZLMmpY/recent-ai-model-progress-feels-mostly-like-bullshit

#HackerNews #AI #Progress #AI #Models #Critique #Technology #Discussion #LessWrong

It always ends up the same way, "I should do what I want, and I want to do cruel, weird shit to other people without their consent"
Yawn.

#Zizians #LessWrong #Rationalists

It always ends up the same way, "I should do what I want, and I want to do cruel, weird shit to other people without their consent"
Yawn.

#Zizians #LessWrong #Rationalists

These techno-cults are better than fiction.
https://maxread.substack.com/p/the-zizians-and-the-rationalist-death
#lesswrong #tescreal

lol of course the rationalist reporter kelsey piper supports james damore. rationalists have never met a sexist/racist/etc computer toucher they didn't like. #rationalism #lesswrong #effectivealtruism

потерял точилку на кухне

интересно, есть ли "рациональные" способы поиска потерянного? (точилка подарок, поэтому есть эмоциональная привязанность)

получил обновление своих убеждений о мире и о своих навыках искать точилку

#lesswrong #рациональность #лытдыбр #хумор

потерял точилку на кухне

интересно, есть ли "рациональные" способы поиска потерянного? (точилка подарок, поэтому есть эмоциональная привязанность)

получил обновление своих убеждений о мире и о своих навыках искать точилку

#lesswrong #рациональность #лытдыбр #хумор

hello!

i’m ainslee. i’m new in town…

i spend time in these places
#lasvegas #reno #nevada #losangeles

i study these things
#datascience #data #computers #compsci #comptia #ai #llm #aiethics #statistics #redistricting #pitzercollege #5cs

i do this stuff when i have free time
#blog #soldering #linux #manjaro #BikeTooter #biking #raspberrypi #defcon

i like reading about these
#technews #gadgetsnews #theverge #copyright #socialweb #lesswrong #effectivealtruism #infosec #uspol #nvpol

i am trying to be these things
#sysadmin #it #gradschool #unr

say hi maybe?

hello!

i’m ainslee. i’m new in town…

i spend time in these places
#lasvegas #reno #nevada #losangeles

i study these things
#datascience #data #computers #compsci #comptia #ai #llm #aiethics #statistics #redistricting #pitzercollege #5cs

i do this stuff when i have free time
#blog #soldering #linux #manjaro #BikeTooter #biking #raspberrypi #defcon

i like reading about these
#technews #gadgetsnews #theverge #copyright #socialweb #lesswrong #effectivealtruism #infosec #uspol #nvpol

i am trying to be these things
#sysadmin #it #gradschool #unr

say hi maybe?

#LessWrong is a community blog focused on "refining the art of human #rationality." To this end, it focuses on identifying and overcoming bias, improving judgment and problem-solving, and speculating about the future. The blog is based on the ideas of Eliezer Yudkowsky, a research fellow for the Machine Intelligence Research Institute (MIRI; previously known as the Singularity Institute for Artificial Intelligence, and then the Singularity Institute). Many members of LessWrong share Yudkowsky's interests in #transhumanism, artificial intelligence (AI), the #Singularity, and #ai

#RationalWiki #miri #ai
https://rationalwiki.org/wiki/LessWrong

Разобрался в основном с алгоритмом обучения gradual value/policy iteration, прикольненький.

https://gibberblot.github.io/rl-notes/single-agent/policy-iteration.html тут что-то про него

Всё ради того, чтобы разобрать статью. Какого формата статья?

"Смотрите, круто если мы будем reward при обучении с подкреплением не максимизировать, а делать равным чему-то. Вот как это делать. Оказывается, если выбирать интервал, то получается много способов это сделать. Тогда можно наложить всяких ограничений по безопасности, чтобы не улететь по случайности в ту или иную сторону, или не выбирать слишком хардовые шаги и тд"

https://www.lesswrong.com/s/4TT69Yt5FDWijAWab

#ml #lesswrong

Разобрался в основном с алгоритмом обучения gradual value/policy iteration, прикольненький.

https://gibberblot.github.io/rl-notes/single-agent/policy-iteration.html тут что-то про него

Всё ради того, чтобы разобрать статью. Какого формата статья?

"Смотрите, круто если мы будем reward при обучении с подкреплением не максимизировать, а делать равным чему-то. Вот как это делать. Оказывается, если выбирать интервал, то получается много способов это сделать. Тогда можно наложить всяких ограничений по безопасности, чтобы не улететь по случайности в ту или иную сторону, или не выбирать слишком хардовые шаги и тд"

https://www.lesswrong.com/s/4TT69Yt5FDWijAWab

#ml #lesswrong

Jack Dorsey, Bluesky, decentralised social networks and the very common crowd https://davidgerard.co.uk/blockchain/2024/05/10/jack-dorsey-bluesky-decentralised-social-networks-and-the-very-common-crowd/ #Bluesky, #DonaldTrump, #ElonMusk, #FreedomFund, #JackDorsey, #Lesswrong, #Mastodon, #MikeSolana, #Neoreaction, #Nostr, #PaulFrazee, #PeterThiel, #PirateWires, #RichardSpencer, #RobertF.KennedyJr, #Twitter, #Vibecamp

Jack Dorsey, Bluesky, decentralised social networks and the very common crowd https://davidgerard.co.uk/blockchain/2024/05/10/jack-dorsey-bluesky-decentralised-social-networks-and-the-very-common-crowd/ #Bluesky, #DonaldTrump, #ElonMusk, #FreedomFund, #JackDorsey, #Lesswrong, #Mastodon, #MikeSolana, #Neoreaction, #Nostr, #PaulFrazee, #PeterThiel, #PirateWires, #RichardSpencer, #RobertF.KennedyJr, #Twitter, #Vibecamp

On #Rationalism, #EffectiveAltruism, and #PostRationalism:

“Rational Magic”, The New Atlantis (https://www.thenewatlantis.com/publications/rational-magic).

#EliezerYudkowsky #MetaTribe #Rationality #LessWrong #OvercomingBias #SlateStarCodex