{"id":150,"date":"2018-10-13T14:32:17","date_gmt":"2018-10-13T14:32:17","guid":{"rendered":"https:\/\/itp.nyu.edu\/adjacent\/issue-4\/?p=150"},"modified":"2024-05-13T16:19:40","modified_gmt":"2024-05-13T16:19:40","slug":"want-an-intelligent-machine","status":"publish","type":"post","link":"https:\/\/itp.nyu.edu\/adjacent\/issue-4\/want-an-intelligent-machine\/","title":{"rendered":"Want an Intelligent Machine? Give it a Body"},"content":{"rendered":"

We’ve given computers our minds.
\nWe now need to lend them our bodies.<\/span><\/h4>\n

 <\/p>\n

\n

Computers are ubiquitous. Aided by the internet, they have infiltrated our individual, social, and political lives. With the expansion of artificial intelligence and machine learning, they are poised to have even greater impact. But we are at a crossroads.<\/span><\/p>\n

Put simply, there is a problem in placing increasing trust in our machines. Never mind that the average, and even the educated human, doesn’t understand computers so well\u2014\u00a0computers <\/i>don’t understand humans<\/i> so well.<\/span><\/p>\n

Machines are increasingly tackling real-world issues without real-world inputs, and this greatly affects their capacity to be healthy contributors to our society. To address this, we need a massive shift in the way that we\u2014engineers, technologists, sociologists, journalists, ethicists, all of us\u2014approach discussing, designing, researching, and building computational devices.<\/span><\/p>\n

We need to give them the wisdom of embodiment.<\/span><\/p>\n

About ten years ago, I woke up one morning and couldn\u2019t walk. I had developed chronic low back and hip problems from working at my computer, and on this day only a few years after I\u2019d finished college, the symptoms were at their worst. Why would my use of technology harm me physically?<\/span><\/p>\n

The long road of chronic pain management sparked my interest in this relationship. It led eventually to New York University\u2019s Interactive Telecommunications Program, where I recently completed three years of experimentation and research at the intersection of the body and computing. <\/span><\/p>\n

At NYU, I created both interactive performance<\/span><\/a><\/span>s<\/span> and creative tools<\/span><\/a>. I read voraciously. The more I learned, the more I understood the vast gulf between the way people interact with the real world and the way they interact with virtual ones. My intellect began to embrace what the rest of me had realized long ago: by and large, computing focuses on the mind and ignores the body. This affects our physical, mental, and social well-being. <\/span><\/p>\n

It doesn\u2019t have to be this way. To get past abstractions, picture a Thursday morning in the not-so-distant future.<\/span><\/p>\n

Your alarm goes off, and you feel refreshed. It\u2019s about an hour later than you thought you would wake, but you don\u2019t worry. The alarm knows your patterns, and rings when you complete your sleep cycle; your calendar has been reworked to accommodate the extra shut-eye. Hungry, you go to the kitchen, where your grocery delivery has been optimized for your biology, the time of year, and your upcoming weekend schedule. You shower, get dressed, then head outside to the driverless car that arrives just in time to whisk you to work. On the way, you rest your head and review some op-eds and policy papers for voting in your local primaries. Nearly imperceptible bands around your wrists allow your fingers to control images on contact lenses and sound through a tiny listening device behind your ear. Your intelligent OS has collected everything you asked for last night, checked its facts and credibility, and built an audiovisual briefing just for you. You complete your ballot by voice and sign it with your unique hand gesture. <\/span><\/p>\n

Here you have every tech optimist\u2019s muse: a world where technology is seamlessly integrated into our lives, making us more productive, more balanced. Giving us superpowers without detracting from our day-to-day lives, from our ability to do meaningful work, or from spending time with the people we love. Making us better, singly and collectively.<\/span><\/p>\n

To be sure, if we\u2019ve learned nothing else in our relationship with tech, it\u2019s that there are unanticipated effects and applications, not all of them good. Indeed, this world is also every science fiction writer\u2019s muse, the foundation for dystopia.<\/span><\/p>\n

The utopian vision depends on technology operating in the best interests of each user and of society as a whole. That\u2019s a tall order, harder to envision than the acknowledged potential for abuse. Nonetheless, let\u2019s play the optimist for a moment. Imagine that we want to begin<\/i> working toward tech utopia. How might we understand even one user\u2019s best interest?<\/span><\/p>\n

Conventional design wisdom suggests we study the user, her behavior, her needs.<\/span><\/p>\n

Today\u2019s computer boils her down to a set of disconnected usage numbers input through a keyboard and mouse, maybe a two-dimensional webcam. But she\u2019s complex. Drawing in an instant on billions of years of evolutionary learning, she processes and stores information from multiple senses, multiple times per second. She then uses the data to inform her personal and societal decisions. <\/span><\/p>\n

If we want a shot at the tech utopia\u2014one where computers take a responsible role in our individual and shared lives\u2014we need to help computers think more like humans. We’ve given them our minds. We now need to lend them our bodies.<\/span><\/p>\n

I have a few suggestions to help move us forward.<\/span><\/p>\n

 <\/p>\n

#1 Define the User Holistically<\/h4>\n

 <\/p>\n

Don Norman coined the phrase \u201cuser-experience design\u201d at Apple in the 1990s because he felt design lacked language to cover \u201call aspects\u201d of a person\u2019s experience with a system<\/span><\/a>. Since then, he is the first to admit, the term has become overused and the concept underused.<\/span><\/p>\n

Most design still defines \u201cuser\u201d too narrowly\u2014by the mental tasks she is trying to perform, with little or no regard for her body. The result is hours of disembodied computing time, often impairing posture, physical well-being, self-esteem, productivity, and social skills.<\/span><\/p>\n

Some might argue that fixing this is the sole realm of hardware designers. I say: Hogwash.<\/span><\/p>\n

Software creators design moment-to-moment experiences for billions of users. Although these creators work within the confines of hardware, they have immense flexibility from there. Facebook, for example, chose<\/i> to design an endless feed of updates that keeps people hooked for long periods of time. It could have designed a feed that ends in three minutes, then encourages users to look up from their phones, maybe do some neck rolls, or go for a walk. It sounds outlandish in today\u2019s advertising-driven online environment, but I would venture to guess that social media users would prefer an application that fosters healthy behaviors over addictive, voyeuristic ones.<\/span><\/p>\n

Today we reconstruct our faces<\/span><\/a> to fit two-dimensional cameras<\/span><\/a>, distort our spines<\/span><\/a> to stay connected, and choose screens over sleep<\/span><\/a>. Such side effects must be front and center for hardware and software creators as they design tomorrow\u2019s digital experiences. Pretending technology isn\u2019t deeply connected to physical, mental, and social well-being is not only out of touch, it\u2019s dangerous<\/span><\/a>. <\/span><\/p>\n

Shifting to seeing users as whole persons will take work. How does embodiment affect users\u2019 needs and abilities? How do hearing, seeing, speaking, feeling, tasting, and smelling affect their desire and ability to perform a task? How does the task move with the user beyond the immediate computing session? What does a user experience look like when you think holistically throughout the user\u2019s 24-hour day? How do designers identify and accommodate seemingly infinite variety among individuals?<\/span><\/p>\n

 <\/p>\n

\"Illustration<\/p>\n

 <\/p>\n

#2 Question \u201cIntelligence\u201d<\/h4>\n

 <\/p>\n

The terms \u201cartificial intelligence\u201d and \u201cmachine learning\u201d are sprinkled on everything from marketing to manufacturing, but few people have more than a cursory understanding of their meanings and how they work. <\/span><\/p>\n

The very definitions are problematic. Machine \u201cintelligence\u201d and \u201clearning\u201d are often linked to the human variety and lumped into a concept of \u201cgeneral intelligence<\/span><\/a>\u201d that ranges from low to high. In fact, in computing, distinct \u201cintelligences\u201d are increasingly specialized\u2014for chess playing<\/span><\/a> or fruit sorting<\/span><\/a>, to name just two. <\/span><\/p>\n

Conflating computer and human intelligence causes confusion inside and outside of tech circles, and limits both understanding and innovation. We can remedy this by improving the language we use to distinguish machine from human. Practitioners, academics, and thinkers should consider a new framework for discussing the field. Neuroscience<\/span><\/a> and pedagogy\u2014 particularly Howard Gardner\u2019s theory of multiple intelligences<\/span><\/a>\u2014are helpful starting places. <\/span><\/p>\n

Language is part of the issue. Also critical are fundamental differences in how humans and machines learn. To understand the problem, look at embodied cognition.<\/span><\/p>\n

Embodied cognition is the theory that our bodies inform our minds. It goes beyond mind-body connection to posit that the mind \u201carises from the nature of our brains, bodies, and bodily experiences<\/span><\/a>.\u201d Computers, in contrast, learn through opaque artificial neurons<\/span><\/a> trained with pre-processed data that lacks physical grounding. <\/span><\/p>\n

The idea that machine intelligence would benefit greatly from human-like bodily awareness is not new. Alan Turing discussed it as early as the 1950s, embodied cognition entered the AI\/ML discussion in the 1980s, and recently researchers at IBM<\/span><\/a>, Facebook<\/span><\/a>, and elsewhere have dipped their toes in this realm. But application of the concept is as difficult as the body is complex<\/span><\/a>, and meaningful progress will take time.<\/span><\/p>\n

We should use this time to expand our knowledge. Yes, AI\/ML researchers and academics will continue to explore embodied learning. People working in fields affected by this research and those who report on it have responsibility too. This is a nascent field with long-term implications for every one of us. Let\u2019s not pretend to understand what is unknown. Rather, let\u2019s get involved: Read, ask questions, understand the technology\u2019s powers and limitations, then question what we\u2019ve learned. <\/span><\/p>\n

We need to push the limits of discovery now, before the silicon hardens.\u00a0<\/span><\/p>\n

Of course, many artificial intelligences (like the aforementioned chess player) don\u2019t need<\/i> the embodied nuances that humans carry into life. But intelligences taking on social roles do. Today we invite AI\/ML to get involved in the criminal justice system<\/span><\/a><\/span>,<\/span> moderate our political discussions<\/span><\/a>, and reform our economy<\/span><\/a>. While it may not be possible or desirable to create machines that fully mimic human embodiment, getting to the heart of the body\u2019s importance in intelligence and learning would give computers a finer understanding of the complex questions we increasingly outsource to them.<\/span><\/p>\n

 <\/p>\n

#3 Take an Embodied View of Data Collection<\/h4>\n

 <\/p>\n

There\u2019s a disconnect in what computers were originally built for \u2014 solving analytical problems \u2014 and what they are now being used for \u2014 interacting with the world at large. Machine learning indeed shows promise in helping the computer transition to social actor. But it brings to light a central difficulty: data. <\/span><\/p>\n

Machines learn from data collected mostly online through intermediaries, like mouse and keyboard. The result is worlds away from the rich embodied data that people absorb in daily life.<\/span><\/p>\n

If we want machines to think more like humans, we need to narrow the gap. <\/span><\/p>\n

In computing\u2019s early days, inputs were limited. The leap forward in mobile and wearable technology offers a plethora. We can now detect motion, location, position, depth, vital signs, voice, and so on. We also have increasing connectivity, storage, and computing power. We can begin to change the ways people interface with their computers, and ultimately how computers understand people and their environments.<\/span><\/p>\n

But an embodied view of data goes beyond collection. Just as we have certain unalienable rights in our real bodies, we must extend those rights to our increasingly extended selves. <\/span><\/p>\n

Ethics and privacy laws rarely keep pace with technology. We should take greater care that they do. Political and business leaders need to wake up<\/a> to today\u2019s realities and prioritize data and privacy policy; thinkers<\/a> who raise these concerns should get prompt attention. Designers and developers can do their part by being proactive<\/a> and considering possible negative outcomes.<\/p>\n

Advising people to relinquish more personal data pushes against my comfort zone. I\u2019m wary of data collection, as many of you probably are. Still, I agree with Kevin Kelly\u2019s assertion<\/span><\/a> that \u201ctracking\u201d is a trend on its way in, not out. Rather than fight it, I say we make it better.<\/span><\/p>\n

If we act with humanity and responsibility, there is, I would argue, much to be gained. The data collected today will lay the groundwork for the programs and environments of the future. The more we know, the more we can make informed decisions and informed software and hardware. Go back to my observations about defining the user holistically. What can we learn outside of keyboard and mouse input? How do environment, mood, touch, movement, temperature, sound, smell, or taste affect the user? <\/span><\/p>\n

We don\u2019t completely fathom how these factors affect us without<\/i> the computer as intermediary. How might data obtained with more intelligent collection aid us in better knowing ourselves? To belabor the point: If, as Kelly puts it<\/span><\/a>, <\/span>“we are not really beings, but \u2018becomings,\u2019” how could reimagined information help us on our journey?<\/span><\/p>\n

 <\/p>\n

#4 Realize We Are in a Paradigm Shift<\/h4>\n

 <\/p>\n

Personal computers and the internet have been changing the world for three decades, while in just five years, accelerated adoption of smartphones and social media have brought computers to ubiquity. Concurrently, the combination of big data, faster processors, and deep learning have spawned a wave of advancement in AI\/ML. These factors converge to create a paradigm shift.<\/span><\/p>\n

Paradigm shifts require new ways of thinking. But the new can be stymied by the old. Take web design: Mobile accounts for more than 50 percent (and rising) of global web traffic, yet most designers and engineers aim first at desktop, keyboard, and mouse, and second at mobile and touch.<\/span><\/p>\n

New thinking takes time to develop. It requires a lot of mental capital. The process is messy, ugly, and results sometimes in terrible ideas. It\u2019s hard to force ourselves to go to these depths, especially when what we know has worked for us this far.<\/span><\/p>\n

But wading through the swamp of possibility is the only way to arrive at true innovation. And only true innovation will ensure that when we look at our technology 20 or 50 years from now, we see systems that reflect our embodied humanity, not just the dark corners of our disembodied minds.<\/span><\/p>\n

 <\/p>\n

#5 Go for Walks. Lots of Them.<\/h4>\n

 <\/p>\n

We don\u2019t have a fully logical explanation of the mind-body connection. Maybe that\u2019s because there\u2019s no way to \u201clogically\u201d understand what we intuit through embodiment. What we do know is that our embodiment informs who we are, and how we relate to ourselves, others, and the environments we share.<\/span><\/p>\n

Our current connected technology takes us out of our embodiment. It translates our world into a place defined by the mind\u2019s output without the underpinnings of the body\u2019s input. To innovate in ways that evolve this relationship, we need to continue to explore who we are outside of our devices.<\/span><\/p>\n

Preparing to put my initial thoughts to paper several weeks ago, I went for one of the many walks that have shaped this article. That first afternoon, I returned wondering whether I\u2019d always have to get away from my technology to feel present and grounded in the world around me. The answer from tonight\u2019s walk: It will depend on how well that technology is grounded in the world around me. <\/span><\/p>\n

So: Go for walks, leaving the smart phone and tablet behind. Use the time to understand how your physicality informs you. Bring this understanding back into your work with technology. Think of Virginia Woolf, who used her walks through England\u2019s South Downs to gain space to spread out her mind<\/span><\/a>. We are building the hive-mind of the future. Will it know that space?<\/span><\/p>\n

—<\/p>\n","protected":false},"excerpt":{"rendered":"

We’ve given computers our minds. We now need to lend them our bodies.   Computers are ubiquitous. Aided by the internet, they have infiltrated our individual, social, and political lives. With the expansion of artificial intelligence and machine learning, they […]<\/p>\n","protected":false},"author":1,"featured_media":149,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[18],"tags":[],"class_list":["post-150","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-issue-4"],"_links":{"self":[{"href":"https:\/\/itp.nyu.edu\/adjacent\/wp-json\/wp\/v2\/posts\/150"}],"collection":[{"href":"https:\/\/itp.nyu.edu\/adjacent\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/itp.nyu.edu\/adjacent\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/itp.nyu.edu\/adjacent\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/itp.nyu.edu\/adjacent\/wp-json\/wp\/v2\/comments?post=150"}],"version-history":[{"count":1,"href":"https:\/\/itp.nyu.edu\/adjacent\/wp-json\/wp\/v2\/posts\/150\/revisions"}],"predecessor-version":[{"id":2361,"href":"https:\/\/itp.nyu.edu\/adjacent\/wp-json\/wp\/v2\/posts\/150\/revisions\/2361"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/itp.nyu.edu\/adjacent\/wp-json\/wp\/v2\/media\/149"}],"wp:attachment":[{"href":"https:\/\/itp.nyu.edu\/adjacent\/wp-json\/wp\/v2\/media?parent=150"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/itp.nyu.edu\/adjacent\/wp-json\/wp\/v2\/categories?post=150"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/itp.nyu.edu\/adjacent\/wp-json\/wp\/v2\/tags?post=150"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}