Eliezer Yudkowsky, a 44-year-old academic wearing a grey polo shirt, rocks slowly on his office chair and explains with real patience – taking things slowly for a novice like me – that every single person we know and love will soon be dead. They will be murdered by rebellious self-aware machines. “The difficulty is, people do not realise,” Yudkowsky says mildly, maybe sounding just a bit frustrated, as if irritated by a neighbour’s leaf blower or let down by the last pages of a novel. “We have a shred of a chance that humanity survives.”
It’s January. I have set out to meet and talk to a small but growing band of luddites, doomsayers, disruptors and other AI-era sceptics who see only the bad in the way our spyware-steeped, infinitely doomscrolling world is tending. I want to find out why these techno-pessimists think the way they do. I want to know how they would render change. Out of all of those I speak to, Yudkowsky is the most pessimistic, the least convinced that civilisation has a hope. He is the lead researcher at a nonprofit called the Machine Intelligence Research Institute in Berkeley, California, and you could boil down the results of years of Yudkowsky’s theorising there to a couple of vowel sounds: “Oh fuuuuu–!”
https://i.guim.co.uk/img/static/sys-images/Guardian/Pix/contributor/2015/6/2/1433240387293/Tom-Lamont.jpg?width=300&quality=85&auto=format&fit=max&s=b07713bf29d30396d20600b6d3c183d2","bylineLargeImageUrl":"https://i.guim.co.uk/img/uploads/2017/10/09/Tom-Lamont,-L.png?width=300&quality=85&auto=format&fit=max&s=e29bd4c5a19f9726508c2957041afd7a"},{"id":"publication/theguardian","type":"Publication","title":"The Guardian"},{"id":"theguardian/saturday","type":"NewspaperBook","title":"Saturday"},{"id":"theguardian/saturday/features","type":"NewspaperBookSection","title":"Features"},{"id":"tracking/commissioningdesk/saturday-magazine","type":"Tracking","title":"Saturday Magazine"}],"isPaidContent":false,"isPreview":false,"host":"
https://www.theguardian.com","pageId":"technology/2024/feb/17/humanitys-remaining-timeline-it-looks-more-like-five-years-than-50-meet-the-neo-luddites-warning-of-an-ai-apocalypse","idUrl":"https://profile.theguardian.com","switches":{"prebidAppnexusUkRow":true,"abSignInGateMainVariant":true,"lightbox":true,"ophanNext":true,"commercialMetrics":true,"prebidTrustx":true,"scAdFreeBanner":false,"adaptiveSite":true,"prebidPermutiveAudience":true,"compareVariantDecision":false,"enableSentryReporting":true,"lazyLoadContainers":true,"ampArticleSwitch":true,"remarketing":true,"articleEndSlot":true,"keyEventsCarousel":true,"registerWithPhone":false,"targeting":true,"remoteHeader":true,"slotBodyEnd":true,"prebidImproveDigitalSkins":true,"ampPrebidOzone":true,"extendedMostPopularFronts":true,"emailInlineInFooter":true,"showNewPrivacyWordingOnEmailSignupEmbeds":true,"deeplyRead":false,"prebidAnalytics":true,"extendedMostPopular":true,"ampContentAbTesting":false,"prebidCriteo":true,"okta":false,"imrWorldwide":true,"acast":true,"automaticFilters":true,"twitterUwt":true,"prebidAppnexusInvcode":true,"ampPrebidPubmatic":true,"a9HeaderBidding":true,"prebidAppnexus":true,"enableDiscussionSwitch":true,"prebidXaxis":true,"stickyVideos":true,"interactiveFullHeaderSwitch":true,"discussionAllPageSize":true,"prebidUserSync":true,"audioOnwardJourneySwitch":true,"brazeTaylorReport":false,"abConsentlessAds":true,"externalVideoEmbeds":true,"abIntegrateIma":true,"callouts":true,"sentinelLogger":true,"geoMostPopular":true,"weAreHiring":false,"relatedContent":true,"thirdPartyEmbedTracking":true,"prebidOzone":true,"ampLiveblogSwitch":true,"ampAmazon":true,"prebidAdYouLike":true,"mostViewedFronts":true,"discussionInApps":false,"optOutAdvertising":true,"abSignInGateMainControl":true,"headerTopNav":true,"googleSearch":true,"brazeSwitch":true,"darkModeInApps":true,"prebidKargo":true,"consentManagement":true,"crosswordMobileBanner":true,"personaliseSignInGateAfterCheckout":true,"redplanetForAus":true,"prebidSonobi":true,"idProfileNavigation":true,"confiantAdVerification":true,"discussionAllowAnonymousRecommendsSwitch":false,"dcrTagPages":true,"permutive":true,"comscore":true,"ampPrebidCriteo":true,"abMpuWhenNoEpic":false,"newsletterOnwards":false,"youtubeIma":true,"webFonts":true,"prebidImproveDigital":true,"ophan":true,"crosswordSvgThumbnails":true,"prebidTriplelift":true,"weather":true,"disableAmpTest":true,"prebidPubmatic":true,"serverShareCounts":false,"autoRefresh":true,"enhanceTweets":true,"prebidIndexExchange":true,"prebidOpenx":true,"prebidHeaderBidding":true,"mobileDiscussionAds":false,"idCookieRefresh":true,"discussionPageSize":true,"smartAppBanner":false,"abPrebidKargo":false,"boostGaUserTimingFidelity":false,"historyTags":true,"brazeContentCards":true,"surveys":true,"remoteBanner":true,"emailSignupRecaptcha":true,"prebidSmart":true,"shouldLoadGoogletag":true,"inizio":true}}" config="{"renderingTarget":"Web","darkModeAvailable":false}" data-island-status="hydrated">
“If you put me to a wall,” he continues, “and forced me to put probabilities on things, I have a sense that our current remaining timeline looks more like five years than 50 years. Could be two years, could be 10.” By “remaining timeline”, Yudkowsky means: until we face the machine-wrought end of all things. Think Terminator-like apocalypse. Think Matrix hellscape. Yudkowsky was once a founding figure in the development of human-made artificial intelligences – AIs. He has come to believe that these same AIs will soon evolve from their current state of “Ooh, look at that!” smartness, assuming an advanced, God-level super-intelligence, too fast and too ambitious for humans to contain or curtail. Don’t imagine a human-made brain in one box, Yudkowsky advises. To grasp where things are heading, he says, try to picture “an alien civilisation that thinks a thousand times faster than us”, in lots and lots of boxes, almost too many for us to feasibly dismantle, should we even decide to.
Trying to shake humanity from its complacency about this, Yudkowsky published an op-ed in Time last spring that advised shutting down the computer farms where AIs are grown and trained. In clear, crisp prose, he speculated about the possible need for airstrikes targeted on datacentres; perhaps even nuclear exchange. Was he on to something?
Replies