Worth reading Superintelligence by Bostrom. We need to be super careful with AI. Potentially more dangerous than nukes.
Vladimir Nesov
@vladimirnesov
Vladimir Nesov’s Tweets
Why is the word "dreams" used to describe both pseudorandom nocturnal hallucinations and also heartfelt aspirations for real life?
3
10
4
Human value depends on the world. Running a theorem prover establishes a
dependence of human value on the theorem prover's theory.
1
When asked to be specific, give a description that abounds with implicit non-trivial consequences.
4
An agent controls its output without controlling its program. Could the value of the world be controlled without control over its state?
1
A consequentialist formal system decides which theorems to have based on the hypothetical consequences of their truth about its models.
2
Concepts are inference applicability heuristics; ruling X an instance of Y without expecting novel inferences is cargo cult classification.
8
14
A game composes players' responses to their beliefs with the dependence of their beliefs on each other's responses.
1
2
Nick Bostrom's Fable of the Dragon Tyrant in Philosophy Now: philosophynow.org/issues/89/The_
2
1
Decisions are self-fulfilling beliefs; actions are self-fulfilling evidence.
1
1
1
Compartmentalization is sustained by cached hidden inferences of propriety of context.
2
You are not your mind; you are the one who comes after, observing, and one who comes before, determining.
1
5
Epistemic rationality is about forming accurate understanding of the decision problem, not just the world.
1
3
5
Improving the territory takes a good map, a part of the territory particularly worth improving and depicting in detail.
"Safe" is a wrong word for describing a process of rewriting the universe.
2
"Think for yourself" sounds vaguely reasonable only because of the abominable incompetence of those tasked with thinking for us.
14
16
Correct weak arguments should often be ignored as filtered justifications obscuring wrong or unknown real reasons.
2
4
Beliefs have parts. Only the whole thing is controlled by the territory, even if every part is essential.
2
Every fact should be consequentialist. Future actions are just an obvious special case.
Tabooing unclear words increases clarity of discussion, but creates a risk of losing its original purpose.
1
Morally relevant facts are not those that move your decisions, but those whose shape of dependence on your decisions moves your decisions.
1
2
6
Many questions are meaningless, irrelevant or misleading, and shouldn't be met with a simple answer. Some of them can be improved.
1
1
Status adaptations make people confuse questions of fact with questions of their current position on that fact.
2
4
Tools can be used without knowledge of how they work; likewise, accurate decisions don't require detailed knowledge of consequences.
1
4
Those who were seen hopping around the room pounding things with loaves of bread were thought insane by those who could not hear the music.
2
2
Cultural transmission of knowledge permits a separation of learning and epistemology. This leads to greater sanity inequality.
1
1
I am trapped in a mortal body on a planet ruled by mad monkeys who are going to blow up the universe.
6
5
When acting contrary to habit looks like a tradeoff, consider changing the habit.
1
1
Politeness is about deniable transactions in blame, status and responsibility.
1
5








