https://locusmag.com/2020/11/cory-doctorow-past-performance-is-not-indicative-of-future-results/ [locus-head] Locus Online Locus Online The Magazine of the Science Fiction and Fantasy Field Subscribe! * All Posts * News + Awards + Announcements + Publishing + New Titles & Bestsellers + Conventions + Obituaries * Reviews + Books + Short Fiction + Films + Index to Reviews * Features + Interviews o Index to Interviews + Spotlights + Commentary o Cory Doctorow o Kameron Hurley o Roundtable o SF Crossing the Gulf * Subscribe * Advertise * Donate * About + Submission Guidelines + Contact Us + Staff + History of Locus Magazine o Charles N. Brown (1937-2009) o Locus Online + FAQ + Code of Conduct + Store * Resources + Forthcoming Books + Index to Interviews + Index to Reviews + Directories + Science Fiction Awards Database + Conventions List + Links by Category + Store * My Account [ ] [Cory2017_800x400-800x400] Commentary Cory Doctorow Features Cory Doctorow: Past Performance is Not Indicative of Future Results November 2, 2020December 14, 2020 locusmag 0 Comments Commentary, Cory Doctorow Cory DoctorowPhoto by Paula Mariel Salischiker In "Full Employment", my July 2020 column, I wrote, "I am an AI skeptic. I am baffled by anyone who isn't. I don't see any path from continuous improvements to the (admittedly impressive) 'machine learning' field that leads to a general AI any more than I can see a path from continuous improvements in horse-breeding that leads to an internal combustion engine." Today, I'd like to expand on that. Let's talk about what machine learning is: it's a statistical inference tool. That means that it analyzes training data to uncover correlations between different phenomena. Your phone observes that every time you type "hey," you usually follow it with "darling" and it learns to autosuggest this the next time you type "hey." It's not sorcery, it's "magic" - in the sense of being a parlor trick, something that seems baffling until you learn the underlying method, whereupon it becomes banal. Automating the detection of statistical correlates is useful! Two eyes, a nose and a mouth are correlated with a face with a very high (albeit imperfect) degree of reliability. Likewise for the features that predict a car or a cat, a helicopter or an AR-15. Certain visible features are a good predictor of skin cancer, and certain waveforms reliably correspond to written words. Machine learning has bequeathed us a wealth of automation tools that operate with high degrees of reliability to classify and act on data acquired from the real world. It's cool! But that's not the whole story. Machine learning is theory-free: it doesn't know about mouths and eyes and noses - it knows that it had labelled training data that identified certain geometrical forms as representative of a face. That's why we get those amusing stories about doorbell cameras that hallucinate faces in melting snow and page their owners to warn them about lurking strangers. Anyone who's ever stared at clouds knows there are plenty of face-like elements of our real world, and no statistical picture of "face-ness" is a perfect substitute for understanding what a face actually is. The problems of theory-free statistical inference go far beyond hallucinating faces in the snow. Anyone who's ever taken a basic stats course knows that "correlation isn't causation." For example, maybe the reason cops find more crime in Black neighborhoods because they harass Black people more with pretextual stops and searches that give them the basis to unfairly charge them, a process that leads to many unjust guilty pleas because the system is rigged to railroad people into pleading guilty rather than fighting charges. Understanding that relationship requires "thick description" - an anthropologist's term for paying close attention to the qualitative experience of the subjects of a data-set. Clifford Geertz's classic essay of the same name talks about the time he witnessed one of his subjects wink at the other, and he wasn't able to determine whether it was flirtation, aggression, a tic, or dust in the eye. The only way to find out was to go and talk to both people and uncover the qualitative, internal, uncomputable parts of the experience. Quantitative disciplines are notorious for incinerating the qualitative elements on the basis that they can't be subjected to mathematical analysis. What's left behind is a quantitative residue of dubious value... but at least you can do math with it. It's the statistical equivalent to looking for your keys under a streetlight because it's too dark where you dropped them. This is not a good way to solve problems. In August, a group of physicists made headlines when they designed a model to predict the spread of the novel coronavirus at Michigan's Albion College. The physicists made a bunch of unwise remarks about a) how easy epidemiology was compared to physics; and b) how effective their model would be at suppressing the spread of the disease, limiting the total case-count to not more than 100, and that was the worst-case scenario. Naturally, the number of cases shot up over 700 in a matter of days and the campus had to shut down. The model accounted perfectly for all the quantitative elements and discarded the qualitative ones, like the possibility that students might get drunk and attend eyeball-licking parties. Machine learning operates on quantitative elements of a system, and quantizes or discards any qualitative elements. And because it is theory-free - that is, because it has no understanding of the causal relationships between the correlates it identifies - it can't know when it's making a mistake. The role this deficit plays in magnifying bias has been well-theorized and well-publicized by this point: feed a hiring algorithm the resumes of previously successful candidates and you will end up hiring people who look exactly like the people you've hired all along; do the same thing with a credit-assessment system and you'll freeze out the same people who have historically faced financial discrimination; try it with risk-assessment for bail and you'll lock up the same people you've always slammed in jail before trial. The only difference is that it happens faster, and with a veneer of empirical facewash that provides plausible deniability for those who benefit from discrimination. But there's another important point to make here - the same point I made in "Full Employment" in July 2020: there is no path of continuous, incremental improvement in statistical inference that yields understanding and synthesis of the sort we think of when we say "artificial intelligence." Being able to calculate that Inputs a, b, c... z add up to Outcome X with a probability of 75% still won't tell you if arrest data is racist, whether students will get drunk and breathe on each other, or whether a wink is flirtation of grit in someone's eye. We don't have any consensus on what we meant by "intelligence," but all the leading definitions include "comprehension," and statistical inference doesn't lead to comprehension, even if it sometimes approximates it. Look at it this way: long before the internal combustion engine, people knew about gas expansion and understood pistons. But the tolerances needed for the controlled explosions at the heart of internal combustion are not really available to blacksmiths who practice metal-beating. The very best smith could hammer metal into something close to a piston, and maybe could refine that piston into something functional, but only by throwing away a lot of off-tolerance items. The resulting engine would be halting and unreliable, and would have no path to reliability that did not abandon metal-beating altogether in favor of processes like casting and (more importantly) machining. Machine-learning is metal-beating. Brilliant people have done remarkable things with it. But the idea that if we just get better at statistical inference, consciousness will fall out of it is wishful thinking. It's a premise for an SF novel, not a plan for the future. --------------------------------------------------------------------- Cory Doctorow is the author of Walkaway, Little Brother, and Information Doesn't Want to Be Free (among many others); he is the co-owner of Boing Boing, a special consultant to the Electronic Frontier Foundation, a visiting professor of Computer Science at the Open University and an MIT Media Lab Research Affiliate. --------------------------------------------------------------------- All opinions expressed by commentators are solely their own and do not reflect the opinions of Locus. This article and more like it in the November 2020 issue of Locus. Locus Magazine, Science Fiction FantasyWhile you are here, please take a moment to support Locus with a one-time or recurring donation. We rely on reader donations to keep the magazine and site going, and would like to keep the site paywall free, but WE NEED YOUR FINANCIAL SUPPORT to continue quality coverage of the science fiction and fantasy field. (c)Locus Magazine. Copyrighted material may not be republished without permission of LSFF. * Click to share on Facebook (Opens in new window) * Click to share on Twitter (Opens in new window) * Click to share on Tumblr (Opens in new window) * Click to share on Pinterest (Opens in new window) * * [das-bro]- Previous Colleen Mondor Reviews Brown Girl Ghosted by Mintie Das * You Gotta Kill the Person You Were Born to Be: Josh Pearce and Arley Sorg Discuss LX 2048 with Bonus Film The Speed of Time Next -[lx2048-] Earlier Posts of Interest... [icon1_opt-200x300-157540187] ICon 2019 Report December 4, 2019 locusmag 0 [Issue04_Molesheadshot_200x2] Spotlight on David Moles July 28, 2010 admin 1 [Issue09_Lee_200x273-200x273] Yoon Ha Lee: Axioms & Theorems September 7, 2014 admin 1 Leave a Reply Cancel reply Your email address will not be published. Required fields are marked * [ ] [ ] [ ] [ ] [ ] [ ] [ ] Comment [ ] Name * [ ] Email * [ ] Website [ ] [ ] Notify me of follow-up comments by email. [Post Comment] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] Issue 726 Table of Contents, July 2021 Issues Issue 726 Table of Contents, July 2021 July 1, 2021 locusmag 0 Buy Current Issue: Print & Digital See All Issues Latest Posts Paul Di Filippo Reviews City of Iron and Dust by J.P. Oakes Books Reviews Paul Di Filippo Reviews City of Iron and Dust by J.P. Oakes July 31, 2021 LocEditor 0 Museums Honor Butler and Afrofuturism Announcements Milestones News Museums Honor Butler and Afrofuturism July 30, 2021 locusmag 0 Liz Bourke and Alex Brown Review She Who Became the Sun by Shelley Parker-Chan Books Reviews Liz Bourke and Alex Brown Review She Who Became the Sun by Shelley Parker-Chan July 30, 2021 locusmag 0 2021 Locus Awards Online Report Conventions Features 2021 Locus Awards Online Report July 29, 2021 locusmag 0 Gary K. Wolfe Reviews The Past is Red by Catherynne M. Valente Books Reviews Gary K. Wolfe Reviews The Past is Red by Catherynne M. Valente July 29, 2021 locusmag 0 Black Lives Matter Locus Merchandise Categories Announcements Archives Awards Bestsellers Blinks Blurb Books Bookstores Classic Reprints Commentary Contests Conventions Cory Doctorow Features Films Forthcoming Books Interviews Issues Kameron Hurley Legal Milestones New & Notable New Books New in Paperback News New Titles & Bestsellers Obituaries Periodicals Publishing Reviewers Reviews Roundtable Short Fiction Slider Spotlight Staff Staff Picks Workshops [INS::INS] [legalthanks] What they say Blurb Seanan McGuire on Locus September 28, 2010 locusmag 0 "It is impossible to overstate how important LOCUS is to our community and the greater speculative fiction genre. One of my absolute favorites." * Click to share on Facebook (Opens in new window) * Click to share on Twitter (Opens in new window) * Click to share on Tumblr (Opens in new window) * Click to share on Pinterest (Opens in new window) * [INS::INS] [INS::INS] Archives Archives [Select Month ] Categories Categories[Select Category ] All opinions expressed by commentators, guest bloggers, reviewers, and interviewees are solely their own and do not reflect the opinions of Locus magazine or its staff. Contact Locus SF Foundation dba Locus Publications 655 13th St. #100 Oakland CA 94612 ph. +1-510-339-9196 locus@locusmag.com Weekdays: 9-5 Pacific Time Suggestion, tips, typos? You can send news, tips, and suggestions to locus@locusmag.com. If you see problems or bugs on the site, please let us know and include the URL and also which browser you are using. Follow us! [birdie] [2000px] [Patre] [insta] Locus Magazine and Website cover science fiction, fantasy, young-adult, horror books, short fiction, anthologies, magazines, films, news, conventions, and international. Also interviews with SFF authors, editors, artists, and more. Copyright (c) 2021 Locus Publications. All rights reserved. donate now button PLEASE SUPPORT LOCUS WITH A DONATION TODAY! Locus is a 501(c)(3) non-profit and relies on donations and subscribers to stay alive. Now losing some of our last bookstores to the trials of 2020, Locus needs your support even more to keep publishing the high quality reviews, book and community news, and articles you read here. Our online readers (there are a lot of you!) could support everything Locus does, if each reader donated $5 once a year. But only 1% of our audience pitches in. Please consider making your donation today! CLOSE