A long, long time ago, when my early science fiction reading was focused on Asimov, Bradbury, and Clarke, I read a bunch of Asimov stories about what were then unimaginably powerful computers. One was called “The Feeling of Power” (originally published in 1958) and another was “The Last Question” (originally published in 1956). 60+ years later, technology has finally caught up with imagination and both stories shed light on our current challenges in coping with AI.
[I have to confess that when I was trying to track them down and re-read them for this blog post (50+ years from when I read them initially), I realized that the plot lines I thought I had remembered was completely different from what Asimov actually wrote; testimony to the creativity and elusiveness of human memory!]
In “The Last Question,” there is a highly-advanced computer intelligence called “Multivac.” Across the millennia of the storyline, Multivac is regularly asked the question about how the universe was created and always replies that there is insufficient data to respond. Eventually all human intelligence (we don’t worry about bodies anymore) is uploaded and Multivac amalgamates all human knowledge. Now god-like, it provides and implements the answer.
Now, I can’t predict the extent of AI capabilities five years hence, much less after several millennia, but this story highlights for me its essential limit: AI can’t be more than the sum of its parts. It’s a very deep and fast compilation of what we (think we) know and it is already accelerating the accumulation of knowledge; but it can’t do philosophy, it can’t get to “TRUTH.” It’s a product of science and science is a human and social process of moving towards knowledge and approximating truth. Ditto for art. AI will produce beautiful pictures and moving literary passages (not to mention more succinct business memos), but will it capture the ineffable?
If AI capabilities get to an asymptotic approximation of truth and beauty, this raises, in turn, the two questions: First, if truth and beauty are merely human constructs, then an AI product should be able to achieve that level of capability. Second, even if AIs can only get close, isn’t that sufficient for most people, most of the time. After all, even disregarding the current trends of ‘dumbing down’ and reduced reading, most folks don’t read Shakespeare and Tolstoy very much. Murder mysteries (and SciFi) are fun and “Squid Game” is Netflix’ most popular show. It’s not hard to imagine all AI-designed and produced video series in the next decade. The upshot is that it’s hard to see the limits of AI and, as importantly, leaving a small sliver of ineffability for whatever might be called “true” art and philosophy won’t really matter; much as we all ignore the difference between the Newtonian physics we all live with comfortably and effectively every day and the “true” Einsteinian/quantum physics that actually describes the universe.
“The Feeling of Power” is, nominally, a quite different tale. An interstellar human society is at war and in its dependence on computers, it has forgotten how to do math. One guy rediscovers how to do it and his archaic techniques (well known to any pocket-protected engineer trained in the 20C) are used to win the war.
The question implicit in this story actually predates computers. Asimov lived to see electronic calculators (remember those!) become widespread by the late 20C. I remember by then people were wondering if students were losing the ability to do math manually. Computational power has exponentially accelerated this concern, even before the arrival of AI. Ten years ago, if I had put “cube root of 193” into a Google search bar, it likely would have directed me to a webpage that included a table with a long list of such results. Today, AI-driven search just pops the answer back (btw, it’s 5.779….). Who needs to do math anymore?
All this points to the fragility of human societies and our increasing dependence not only on the technical infrastructure that makes these answers immediately available (e.g., wifi, cellular networks, electrical grids) but on the underlying mathematical and research capabilities themselves (e.g., search engines, YouTube “how-to” videos). Even before AI, it was increasingly clear that my college students didn’t really research their papers; search engines had become a crutch for thinking through both the nature of the problem they were writing on and the logical methods of finding materials that addressed the substantive questions.
A few years ago, there was a flurry of concern about the risk of North Korea or some terrorist group setting off an electro-magnetic pulse (“EMP”) that would fry computers and the electricity network over a wide swath of the US. If you think living without immigrants is a big economic and social problem, imagine going without electricity for a month and facing a year backlog on replacing your computer. Pretty much everything in our infrastructure would collapse.
The likely ubiquity of AI capabilities will increasingly coddle us and enable us to live very nicely without learning and discovering very much. Even without the network crashing, the road to the world described in Asimov’s “Feeling of Power” seems likely to put us at considerable risk of not being able to function independently. In the story, the ability of humans to calculate missile trajectories is used to win a war. [For a similar tale, Arthur C. Clarke’s “Into the Comet” (1960) relies on the use of an abacus on a spaceship to avoid being stranded when the computer burns out.] We need not reach such rarified scenarios to recognize that an element of human psychology and culture that we’ve taken for granted for centuries could easily fade away.
In a groundbreaking historical analysis “The Art of Memory” (1966), Frances Yates studied how humans trained their memories to retain information and culture for millennia and how this art was affected by the rise of print and literacy. As we developed this artificial means of storing information and stories on increasingly readily available paper, our interest in and ability to recall began to fade in the early modern era. It now looks like we’re in the process of doing something similar. Pencil and paper—and the ability to think through problems—are increasingly at risk.
RSS Feed