TECHNOLOGY IS NEITHER GOOD NOR BAD; NOR IS IT NEUTRAL.
1ST LAW OF TECHNOLOGY (KRANZBERG, 1986)
THE FUTURE WILL NOT BE HUMANS, BUT [MACHINES] THAT WILL HAVE DESIGNED AND BUILT THEMSELVES FROM THE AI SYSTEMS WE HAVE ALREADY CONSTRUCTED.
THEY WILL HAVE ARISEN, LIKE US, FROM DARWINIAN EVOLUTION. THEY WILL NOT, AT FIRST, BE SEPARATE TO US; THEY WILL BE OUR OFFSPRING BECAUSE THE SYSTEMS WE MADE TURNED OUT TO BE THEIR PRECURSORS.
NOVACENE. THE COMING AGE OF HYPERINTELLIGENCE (2019)
THE RAPID RISE OF AI HOLDS INCREDIBLE PROMISE, BUT TENDS TO FAVOR WELL-CAPITALIZED COMPANIES WITH LARGE ACCUMULATIONS OF DATA. THE DECISIONS WE MAKE NOW WILL DETERMINE THE FUTURE: WHO BUILDS, OWNS, AND USES IT; WHERE INNOVATION HAPPENS; WHAT THE EXPERIENCE WILL BE FOR EVERYONE.
READ WRITE OWN: BUILDING THE NEXT ERA OF THE INTERNET (2024)
ESSENTIAL DEFINITION OF TERMS -
ARTIFICIAL INTELLIGENCE (AI): THE SCIENCE OF TEACHING MACHINES TO LEARN HUMANLIKE CAPABILITIES.
ARTIFICIAL GENERAL INTELLIGENCE (AGI): THE POINT AT WHICH AN AI CAN PERFORM ALL HUMAN COGNITIVE SKILLS BETTER THAN THE SMARTEST HUMANS.
ARTIFICIAL CAPABLE INTELLIGENCE (ACI): A FAST-APPROACHING POINT BETWEEN AI AND AGI, WHERE AI CAN ACHIEVE A WIDE RANGE OF COMPLEX TASKS BUT IS STILL A LONG WAY FROM BEING FULLY GENERAL.
THE COMING WAVE - AN EMERGING CLUSTER OF RELATED TECHNOLOGIES CENTERED ON AI AND SYNTHETIC BIOLOGY, WHOSE TRANSFORMATIVE APPLICATIONS WILL BOTH EMPOWER HUMANKIND AND PRESENT UNPRECEDENTED RISKS.
CONTAINMENT - THE ABILITY TO MONITOR, CURTAIL, CONTROL, AND POTENTIALLY EVEN CLOSE DOWN TECHNOLOGIES.
THE CONTAINMENT PROBLEM - THE TENDENCY OF TECHNOLOGY TO DIFFUSE WIDELY IN WAVES AND TO HAVE EMERGENT EFFECTS THAT ARE IMPOSSIBLE TO PREDICT OR CONTROL, INCLUDING NEGATIVE AND UNFORESEEN CONSEQUENCES.
THE COMING WAVE: AI, POWER, AND THE 21ST CENTURY'S GREATEST DILEMMA (2023)