Quotessence
Home / Authors / Eliezer Yudkowsky Books
Eliezer Yudkowsky

Eliezer Yudkowsky Books

Writer

Related Quotes

“The Headmaster told Professor Flitwick that this was, indeed, a secret and delicate matter of which he had already been informed, and that he did not think pressing it at this time would help me or anyone. Professor Flitwick started to say something about the Headmaster's usual plotting going much too far, and I had to interrupt at that point and explain that it had been my own idea and not anything the Headmaster forced me into, so Professor Flitwick spun around and started lecturing me, and the Headmaster interrupted him and said that as the Boy-Who-Lived I was doomed to have weird and dangerous adventures so I was safer if I got into them on purpose instead of waiting for them to happen by accident, and that was when Professor Flitwick threw up his little hands and started shrieking in a high-pitched voice at both of us about how he didn't care what we were cooking up together, but this wasn't ever to happen again for as long as I was in Ravenclaw House or he would have me thrown out and I could go to Gryffindor which was where all this Dumbledoring belonged -”

Harry PotterDumbledoreMethods Of RationalityFlitwick
Book:Harry Potter and the Methods of Rationality
Create image

“There's history books you haven't read," Harry said quietly. "There's books you haven't read yet, Hermione, and they might give you a sense of perspective. A few centuries earlier - I think it was definitely still around in the seventeenth century - it was a popular village entertainment to take a wicker basket, or a bundle, with a dozen live cats in it, and -" "Stop," she said. "- roast it over a bonfire. Just a regular celebration. Good clean fun. And I'll give them this, it was cleaner fun than burning women they thought were witches. Because the way people are built, Hermione, the way people are built to feel inside -" Harry put a hand over his own heart, in the anatomically correct position, then paused and moved his hand up to point toward his head at around the ear level, "- is that they hurt when they see their friends hurting. Someone inside their circle of concern, a member of their own tribe. That feeling has an off-switch, an off-switch labeled 'enemy' or 'foreigner' or sometimes just 'stranger'. That's how people are, if they don't learn otherwise. So, no, it does not indicate that Draco Malfoy was inhuman or even unusually evil, if he grew up believing that it was fun to hurt his enemies -”

EvilCultural Relativism
Book:Harry Potter and the Methods of Rationality
Create image

“Dinner passed with surprising rapidity. Harry tried to sample at least a little of all the weird new foods he saw. His curiosity couldn't stand the thought of not knowing how something tasted. Thank goodness this wasn't a restaurant where you had to order only one thing and you never found out what all the other things on the menu tasted like. Harry hated that, it was like a torture chamber for anyone with a spark of curiosity: Find out about only one of the mysteries on this list, ha ha ha!”

Food
Book:Harry Potter and the Methods of Rationality
Create image

“Because the way people are built, Hermione, the way people are built to feel inside -" Harry put a hand over his own heart, in the anatomically correct position, then paused and moved his hand up to point toward his head at around the ear level, "- is that they hurt when they see their friends hurting. Someone inside their circle of concern, a member of their own tribe. That feeling has an off-switch, an off-switch labeled 'enemy' or 'foreigner' or sometimes just 'stranger'. That's how people are, if they don't learn otherwise.”

PsychologyMoralityRationality
Book:Harry Potter and the Methods of Rationality
Create image

“You can only arrive at mastery by practicing the techniques you have learned, facing challenges and apprehending them, using to the fullest the tools you have been taught, until they shatter in your hands and you are left in the midst of wreckage absolute... I cannot create masters. I have never known how to create masters. Go, then, and fail... You have been shaped into something that may emerge from the wreckage, determined to remake your Art. I cannot create masters, but if you had not been taught, your chances would be less. The higher road begins after the Art seems to fail you; though the reality will be that it was you who failed your Art.”

FailureMastery
Book:Harry Potter and the Methods of Rationality
Create image

“That's what I'd tell you if I thought you could be responsible for anything. But normal people don't choose on the basis of consequences, they just play roles. There's a picture in your head of a stern disciplinarian and you do whatever that picture would do, whether or not it makes any sense. A stern disciplinarian would order the students back to their rooms, even if there was a troll roaming the hallways. A stern disciplinarian would order students not to leave the Hall on pain of expulsion. And the little picture of Professor McGonagall that you have in your head can't learn from experience or change herself, so there isn't any point to this conversation. People like you aren't responsible for anything, people like me are, and when we fail there's no one else to blame.”

ChangeRolesAutopilotCorrect Your Mistakes
Author:Eliezer Yudkowsky
Create image

“You have to disentangle the details. You have to hold up every one independently, and ask, "How do we know *this* detail?" Someone sketches out a picture of humanity's descent into nanotechnological warfare, where China refuses to abide by an international control agreement, followed by an arms race ... Wait a minute—how do you know it will be China? Is that a crystal ball in your pocket or are you just happy to be a futurist? Where are all these details coming from? Where did *that specific* detail come from?”

RationalityOccams Razor
Author:Eliezer Yudkowsky
Create image

“Hermione," Harry said seriously, as he started to dig down into the red-velvet pouch again, "don't punish yourself when a bright idea doesn't work out. You've got to go through a lot of flawed ideas to find one that might work. And if you send your brain negative feedback by frowning when you think of a flawed idea, instead of realizing that idea-suggesting is good behavior by your brain to be encouraged, pretty soon you won't think of any ideas at all." Harry put down two heart-shaped chocolates beside the book. "Here, have another chocolate. Besides the one from earlier, I mean. This one is to reinforce your brain for generating a good candidate strategy.”

Positive Reinforcement
Book:Harry Potter and the Methods of Rationality
Create image

“Wow," the empty air finally said. "Wow. That puts a pretty different perspective on things, I have to say. I'm going to remember this the next time I feel an impulse to blame myself for something. Neville, the term in the literature for this is 'egocentric bias', it means that you experience everything about your own life but you don't get to experience everything else that happens in the world. There was way, way more going on than you running in front of me. You're going to spend weeks remembering that thing you did there for six seconds, I can tell, but nobody else is going to bother thinking about it. Other people spend a lot less time thinking about your past mistakes than you do, just because you're not the center of their worlds. I guarantee to you that nobody except you has even considered blaming Neville Longbottom for what happened to Hermione. Not for a fraction of a second. You are being, if you will pardon the phrase, a silly-dilly. Now shut up and say goodbye.”

PsychologyEgocentric Bias
Book:Harry Potter and the Methods of Rationality
Create image

“If you want to win this argument with Dad, look in chapter two of the first book of the Feynman Lectures on Physics. There's a quote there about how philosophers say a great deal about what science absolutely requires, and it is all wrong, because the only rule in science is that the final arbiter is observation - that you just have to look at the world and report what you see. Um... off the top of my head I can't think of where to find something about how it's an ideal of science to settle things by experiment instead of arguments -”

SciencePhysicsObservationRichard FeynmanFeynman
Book:Harry Potter and the Methods of Rationality
Create image

“Aside from helping people with their homework, or anything else they needed, she really didn't know how to meet people. She didn't feel like she was a shy person. She thought of herself as a take-charge sort of girl. And yet, somehow, if there wasn't some request along the lines of "I can't remember how to do long division" then it was just too awkward to go up to someone and say... what? She'd never been able to figure out what. And there didn't seem to be a standard information sheet, which was ridiculous. The whole business of meeting people had never seemed sensible to her. Why did she have to take all the responsibility herself when there were two people involved? Why didn't adults ever help? She wished some other girl would just walk up to her and say, "Hermione, the teacher told me to be friends with you".”

ShynessShy People
Book:Harry Potter and the Methods of Rationality
Create image

“It's a most peculiar psychology—this business of 'Science is based on faith too, so there!' Typically this is said by people who claim that faith is a good thing. Then why do they say 'Science is based on faith too!' in that angry-triumphal tone, rather than as a compliment? And a rather dangerous compliment to give, one would think, from their perspective. If science is based on 'faith', then science is of the same kind as religion—directly comparable. If science is a religion, it is the religion that heals the sick and reveals the secrets of the stars. It would make sense to say, 'The priests of science can blatantly, publicly, verifiably walk on the Moon as a faith-based miracle, and your priests' faith can't do the same.' Are you sure you wish to go there, oh faithist? Perhaps, on further reflection, you would prefer to retract this whole business of 'Science is a religion too!”

HumorSciencePsychologyComparisonPeculiar
Book:The Less Wrong Sequences
Create image

“Then you get the wrong answer and you can't go to the Moon that way! Nature isn't a person, you can't trick them into believing something else, if you try to tell the Moon it's made of cheese you can argue for days and it won't change the Moon! What you're talking about is rationalization, like starting with a sheet of paper, moving straight down to the bottom line, using ink to write 'and therefore, the Moon is made of cheese', and then moving back up to write all sorts of clever arguments above. But either the Moon is made of cheese or it isn't. The moment you wrote the bottom line, it was already true or already false. Whether or not the whole sheet of paper ends up with the right conclusion or the wrong conclusion is fixed the instant you write down the bottom line.”

ScienceHarry PotterRationalityMethods Of Rationality
Book:Harry Potter and the Methods of Rationality
Create image

“I'm not stupid, Mr. Potter. What's the real reason you didn't tell me, and what were you actually doing with Mr. Malfoy?" "Ah. Well..." Harry broke eye contact with her, and looked down at the library table. "Draco Malfoy told the Aurors under Veritaserum that he wanted to know if he could beat me, so he challenged me to a duel to test it empirically. Those were his exact words according to the transcript." "Right," Harry said, still not meeting her eyes. "Hermione Granger. Of course she'll remember the exact wording. It doesn't matter if she's chained to her chair, on trial for murder in front of the entire Wizengamot -" "What were you really doing with Draco Malfoy?" Harry winced, and said, "Probably not quite what you're thinking, but..." The horror scaled and scaled within her, and finally broke loose. "You were doing SCIENCE with him? " "Well -" "You were doing SCIENCE with him? You were supposed to be doing science with ME!”

Science
Book:Harry Potter and the Methods of Rationality
Create image

“It's hard to beat signaling equilibria - because they're 'multi-factor markets' - which are special cases of coordination problems that create 'inferior Nash equilibria' - which are so stuck in place that market controllers can seek rent on the value generated by captive participants.”

CollegeRent SeekingAcademic Publishing
Book:Inadequate Equilibria: Where and How Civilizations Get Stuck
Create image

“The purest case of an intelligence explosion would be an Artificial Intelligence rewriting its own source code. The key idea is that if you can improve intelligence even a little, the process accelerates. It's a tipping point. Like trying to balance a pen on one end - as soon as it tilts even a little, it quickly falls the rest of the way.”

IfsWayTryingLittlesIdeasEndsWould BeFallProcessCasesSourceKeysBalanceCodePensArtificial IntelligenceArtificialExplosionsAccelerateRewritingTippingTiltTipping Point
Author:Eliezer Yudkowsky
Create image

“Most Muggles lived in a world defined by the limits of what you could do with cars and telephones. Even though Muggle physics explicitly permitted possibilities like molecular nanotechnology or the Penrose process for extracting energy from black holes, most people filed that away in the same section of their brain that stored fairy tales and history books, well away from their personal realities: Long ago and far away, ever so long ago.”

PeopleWorldWellsLongBookRealityEnergyProcessBlackBrainCarPossibilityLimitsPhysicsHolesTalesDefinedFairyFairy TaleFar AwayLong AgoSectionsTelephonesBlack HoleHistory BooksNanotechnologyMuggles
Author:Eliezer Yudkowsky
Create image

“Crocker's Rules didn't give you the right to say anything offensive, but other people could say potentially offensive things to you, and it was your responsibility not to be offended. This was surprisingly hard to explain to people; many people would read the careful explanation and hear, "Crocker's Rules mean you can say offensive things to other people."”

PeopleGivingMeanHardResponsibilityCarefulExplanationOffensiveSay AnythingOffended
Author:Eliezer Yudkowsky
Create image

“The human brain cannot release enough neurotransmitters to feel emotion a thousand times as strong as the grief of one funeral. A prospective risk going from 10,000,000 deaths to 100,000,000 deaths does not multiply by ten the strength of our determination to stop it. It adds one more zero on paper for our eyes to glaze over.”

FeelsHumansDoeEnoughEyeStrongGriefEmotionBrainRiskThousandTenPaperDeterminationAddReleaseZeroFuneralHuman BrainNeurotransmitters
Author:Eliezer Yudkowsky
Create image

“Physiologically adult humans are not meant to spend an additional 10 years in a school system; their brains map that onto "I have been assigned low tribal status". And so, of course, they plot rebellion - accuse the existing tribal overlords of corruption plot, perhaps to split off their own little tribe in the savanna, not realizing that this is impossible in the Modern World.”

WorldYearsHumansLittlesHas BeensSchoolCoursesRealizingBrainImpossibleModernLowsAdultsCorruptionPlotMapsRebellionSplitsTribesModern WorldSchool SystemSavanna
Author:Eliezer Yudkowsky
Create image

“My experience is that journalists report on the nearest-cliche algorithm, which is extremely uninformative because there aren't many cliches, the truth is often quite distant from any cliche, and the only thing you can infer about the actual event was that this was the closest cliche. It is simply not possible to appreciate the sheer awfulness of mainstream media reporting until someone has actually reported on you. It is so much worse than you think.”

ThinkingMediaEventsTruth IsAppreciateJournalistReportsMainstreamClosestSheerClicheAlgorithmsMainstream MediaAwfulness
Author:Eliezer Yudkowsky
Create image

“If I'm teaching deep things, then I view it as important to make people feel like they're learning deep things, because otherwise, they will still have a hole in their mind for "deep truths" that needs filling, and they will go off and fill their heads with complete nonsense that has been written in a more satisfying style.”

PeopleIfsNeedsFeelsMindHas BeensStillsImportantViewsWrittenTeachingStyleHolesNonsenseSatisfyingFillingDeep Things
Author:Eliezer Yudkowsky
Create image