Quotessence
Home / Topics / Existential Risk Quotes

Existential Risk Quotes

Browse 14 quotes about Existential Risk.

Existential Risk Quotes

“Since the notion of quality, as understood by [the Swedish Research Council], is supposed to ignore practical applicability, quality as the sole selection criterion means that we value the production of new knowledge and its own right, rather than just a means towards attaining other goals. I have long been – and still am – highly sympathetic to this romantic view of knowledge and intellectual achievements. To improve our understanding of the world we live in really is one of the most magnificent and worthy the goals of human activity one can think of. And yet, it is not the only worthy goal. A bright future for humanity, where everyone has the best possible prospects of leading a happy and prosperous life, and where such things as poverty, pain and misery are reduced to a minimum, seems like another goal worth striving for, at least as important as the quest for ever-increasing knowledge.”

Scientific KnowledgeIntrinsic ValueScientific ProgressExistential RiskGlobal Catastrophic RiskCatastrophic Risk
Book:Here Be Dragons: Science, Technology and the Future of Humanity
Create image

“We cannot rely on trial-and-error approaches to deal with existential risks… We need to vastly increase our investment in developing specific defensive technologies… We are at the critical stage today for biotechnology, and we will reach the stage where we need to directly implement defensive technologies for nanotechnology during the late teen years of this century… A self-replicating pathogen, whether biological or nanotechnology based, could destroy our civilization in a matter of days or weeks.”

HumanityCivilizationNanotechnologyExistential RiskExistential RisksBioweaponBioterrorGrey GooSelf Replicating Pathogen
Book:The Singularity Is Near: When Humans Transcend Biology
Create image

“We urgently need to find ways to push scientific and technological progress in directions that are likely to bring us good, and away from those directions that spell doom. This cannot be done if we stick to the erroneous view that all such progress is good for us. The first thing we need is to be able to distinguish those advances whose potential is most in the direction of prosperity and human flourishing from those whose potential is more in the direction of destruction and doom, and we need to find safe ways to handle those technologies that come with elements of both. Our ability to do so today is very limited, my ambition with this book is to draw attention to the problem, so that we can work together to improve, and avoid running blindfolded at full speed into a dangerous future.”

Scientific ProgressExistential RiskGlobal Catastrophic RiskCatastrophic RiskDifferential Progress
Book:Here Be Dragons: Science, Technology and the Future of Humanity
Create image

“No science and no analysis of the future consequences of various actions taken today can in itself tell us what to do. We need, in addition, to factor in what kind of future we value, and to what extent we care at all about the future compared to more immediate concerns here and now. The later aspect is usually modeled and economics by the so-called discount rate, which has played a prominent role in discussions of climate change on a decadal and centennial time scale, but hardly at all in the context of longer perspectives or the various radical technologies[.] We are less used to thinking about ethical issues on long time scales, so our intuitions trying to fail us and lead to paradoxes. These issues need to be resolved, because dodging the bullet would in my opinion be unacceptably irresponsible.”

Existential RiskGlobal Catastrophic RiskCatastrophic RiskNormative EthicsPopulation Ethics
Book:Here Be Dragons: Science, Technology and the Future of Humanity
Create image

“What now matters most is how we respond to various risks to the survival of humanity. We are creating some of these risks, and discovering how we could respond to these and other risks. If we reduce these risks, and humanity survives the next few centuries, our descendants or successors could end these risks by spreading through this galaxy. Life can be wonderful as well as terrible, and we shall increasingly have the power to make life good. Since human history may be only just beginning, we can expect that future humans, or supra-humans, may achieve some great goods that we cannot now even imagine. In Nietzsche’s words, there has never been such a new dawn and clear horizon, and such an open sea. If we are the only rational beings in the Universe, as some recent evidence suggests, it matters even more whether we shall have descendants or successors during the billions of years in which that would be possible. Some of our successors might live lives and create worlds that, though failing to justify past suffering, would give us all, including some of those who have suffered, reasons to be glad that the Universe exists.”

PhilosophyEthicsMoral PhilosophyConsequentialismExistential RiskEffective AltruismDerek Parfit
Book:On What Matters: Volume 3
Create image

“If all goes well, human history is just beginning. Humanity is about two hundred thousand years old. But the Earth will remain habitable for hundreds of millions more—enough time for millions of future generations; enough to end disease, poverty and injustice forever; enough to create heights of flourishing unimaginable today. And if we could learn to reach out further into the cosmos, we could have more time yet: trillions of years, to explore billions of worlds. Such a lifespan places humanity in its earliest infancy. A vast and extraordinary adulthood awaits.”

Future Of HumanityExistential RiskBig History
Book:The Precipice
Create image

“Maybe the existential risk is not machines taking over the world or reaching human-level intelligence, but rather the opposite where human beings think like idle machines - unable to connect the emerging dots of our complex, systemic world.”

ResilienceArtificial IntelligenceComplex SystemsExistential Risk
Book:The Definitive Guide to Thriving on Disruption: Volume I - Reframing and Navigating Disruption
Create image

“But there is a huge difference between, on one hand, admitting that there severe difficulties, and, on the other, throwing our hands in the air and fatalistically declaring the problem to be unsolvable. We don't know that they are in solvable until we tried, and tried really hard. Given the magnitude of what's at stake, just giving up on the problem is in my opinion unacceptable. The extent to which we are currently neglecting the problem is shocking. Nick Bostrom, in a recent paper, illustrates this with a diagram showing how the number of academic publications on snowboarding outnumbers those on risks of human extinction by a factor of 20 or so, while those on dung beetles beat those on snowboarding by another factor of 2. This should not be taken as a suggestion that too much effort is spent on academic studies of snowboarding and dung beetles, but rather as an indication that current efforts into the study of existential risks to humanity could easily be significantly scaled up without major destruction to the current academic landscape as a whole.”

Existential RiskGlobal Catastrophic RiskCatastrophic RiskExistential Risk Research
Book:Here Be Dragons: Science, Technology and the Future of Humanity
Create image

“But there is a huge difference between, on one hand, admitting that there are severe difficulties, and, on the other, throwing our hands in the air and fatalistically declaring the problem to be unsolvable. We don't know that they are in solvable until we tried, and tried really hard. Given the magnitude of what's at stake, just giving up on the problem is in my opinion unacceptable. The extent to which we are currently neglecting the problem is shocking. Nick Bostrom, in a recent paper, illustrates this with a diagram showing how the number of academic publications on snowboarding outnumbers those on risks of human extinction by a factor of 20 or so, while those on dung beetles beat those on snowboarding by another factor of 2. This should not be taken as a suggestion that too much effort is spent on academic studies of snowboarding and dung beetles, but rather as an indication that current efforts into the study of existential risks to humanity could easily be significantly scaled up without major destruction to the current academic landscape as a whole.”

Existential RiskGlobal Catastrophic RiskCatastrophic RiskExistential Risk Research
Book:Here Be Dragons: Science, Technology and the Future of Humanity
Create image

“If we use, to achieve our purposes, a mechanical agency with whose operation we cannot efficiently interfere once we have started it, because the action is so fast and irrevocable that we have not the data to intervene before the action is complete, then we had better be quite sure that the purpose put into the machine is the purpose which we really desire and not merely a colorful imitation of it.”

PurposeDangerArtificial IntelligencePrudenceExistential RiskHuman Computer InteractionSorcerer S Apprentice
Author:Norbert Wiener
Create image