“If you want to build a recursively self-improving AI, have it go through a billion sequential self-modifications, become vastly smarter than you, and not die, you've got to work to a pretty precise standard.” IfsWantSelfDiesStandardsBillionsSmarterImprovingPreciseModification Author:Eliezer Yudkowsky
“Have I ever remarked on how completely ridiculous it is to ask high school students to decide what they want to do with the rest of their lives and give them nearly no support in doing so? Support like, say, spending a day apiece watching twenty different jobs and then another week at their top three choices, with salary charts and projections and probabilities of graduating that subject given their test scores? The more so considering this is a central allocation question for the entire economy?” WantGivingDifferentSchoolJobsChoicesThreeAsksGivenSupportEconomyWeekSubjectsStudentsHigh SchoolTestsTwentiesSpendingRidiculousScoreGraduatesConsideringProbabilitySalaryProjectionDifferent JobsAllocationHigh School StudentsTest Scores Author:Eliezer Yudkowsky
“If you want to maximize your expected utility, you try to save the world and the future of intergalactic civilization instead of donating your money to the society for curing rare diseases and cute puppies.” IfsWorldWantTryingCivilizationDiseaseExpectedCuteUtilityPuppySave The WorldCute PuppyRare Diseases Author:Eliezer Yudkowsky
“Through rationality we shall become awesome, and invent and test systematic methods for making people awesome, and plot to optimize everything in sight, and the more fun we have the more people will want to join us.” PeopleWantFunTestsSightMethodPlotRationalitySystematic Author:Eliezer Yudkowsky
“I don't want to rule the universe. I just think it could be more sensibly organised.” ThinkingWantUniverseOrganised Author:Eliezer Yudkowsky
