{"id":852,"date":"2017-08-06T16:45:58","date_gmt":"2017-08-06T20:45:58","guid":{"rendered":"https:\/\/itp.nyu.edu\/~jvc301\/wordpress\/?p=127"},"modified":"2017-08-06T16:45:58","modified_gmt":"2017-08-06T20:45:58","slug":"composing-for-interactive-dance-improvisation","status":"publish","type":"post","link":"https:\/\/itp.nyu.edu\/adjacent\/issue-2\/composing-for-interactive-dance-improvisation\/","title":{"rendered":"To Improvise with a Machine: Composing for Interactive Dance"},"content":{"rendered":"<p><span style=\"font-weight: 400\">Apophenia is the tendency to see relationships where there are none. Klaus Conrad first described it in a 1958 work on schizophrenia as &#8220;unmotivated seeing of connections accompanied by a specific feeling of abnormal meaningfulness.&#8221;<\/span><a class=\"fn\" href=\"#fn-1\" name=\"fnn-1\">1<\/a><\/p>\n<p><span style=\"font-weight: 400\">Really, <\/span><a href=\"https:\/\/twitter.com\/hashtag\/pareidolia\"><span style=\"font-weight: 400\">all of us are apopheniacs<\/span><\/a><span style=\"font-weight: 400\">. Unrelated events that take place in the same place at the same time become related by virtue of proximity. Coincidence becomes collusion. Correlation becomes causality.<\/span><\/p>\n<p><span style=\"font-weight: 400\">Apophenia is what allowed the <\/span><a href=\"https:\/\/www.mercecunningham.org\/merce-cunningham\/\"><span style=\"font-weight: 400\">choreographer Merce Cunningham<\/span><\/a><span style=\"font-weight: 400\"> and his collaborators (composer John Cage, visual artist Robert Rauschenberg, and others) to create independently of one another, yet still allow them to come together to occupy \u2018the same time and space\u2019 as a single work. Though the art was created separately, we as an audience perceive them as connected.<\/span><\/p>\n<p><span style=\"font-weight: 400\">Which raises the question, why hook up performers to sensors to control sound and visuals if the relationships between the performers and other media already exist in our minds? <\/span><\/p>\n<p><span style=\"font-weight: 400\">Interactive work must necessarily evolve beyond the novelty of composers, performers, and the audience bearing witness to <\/span><a href=\"https:\/\/youtu.be\/cV5mmi7BBMY?t=20\"><span style=\"font-weight: 400\">cause and effect enabled by newfangled sensors<\/span><\/a><span style=\"font-weight: 400\">. <\/span><span style=\"font-weight: 400\">Interactivity offers up new surface area for exploring the psychology of human choice. As creators of interactive work, we should seize it as a means of upending how choices are made, who gets to make them, and for what purpose.<\/span><\/p>\n<h1><span style=\"font-weight: 400\">Is Interactive Composition a Contradiction in Terms?<\/span><\/h1>\n<p><span style=\"font-weight: 400\">To compose something is to craft it with care. A half-a-step to the left, a half-a-beat late makes all the difference to the detail-oriented composer. On the extreme end, artists such as<\/span><span style=\"font-weight: 400\"> Robert Wilson<\/span><span style=\"font-weight: 400\">\u00a0direct performers on stage with the same level of precision that architects exercise over their drawings (see video below).<\/span><a class=\"fn\" href=\"#fn-2\" name=\"fnn-2\">1<\/a><\/p>\n<p><a href=\"https:\/\/youtu.be\/Ty76wEPL-M4?t=1290\">https:\/\/youtu.be\/Ty76wEPL-M4?t=1290<\/a><\/p>\n<p><span style=\"font-weight: 400\">Interactivity on the other hand, necessarily means a transfer of decision-making power from composer to performers, or, in other words, from designer to users. Performers make the decisions in a performance that shape the overarching composition of the piece\u2014<\/span><i><span style=\"font-weight: 400\">if<\/span><\/i><span style=\"font-weight: 400\"> the composer of the interaction allows them this freedom.<\/span><\/p>\n<p><span style=\"font-weight: 400\">Depending on how the composer creates the interactive system, however, she risks missing the opportunity to transfer power. This happens when user input only affects the output in a limited or superficial way so that no matter what the performer chooses to do, the character of the performance stays the same. <\/span><\/p>\n<p><span style=\"font-weight: 400\">For example, if the height of the performer\u2019s head affects light levels, some questions a composer might ask include: To what extent does the head affect the lighting? What\u2019s done in complete darkness so that it is felt and heard but not seen? What\u2019s done in blinding light? What\u2019s done in twilight so it is only dimly perceived? By interrogating the system in this way, the composer can ensure that it allows enough room for the performer to play around, respond, and ultimately shape the composition.<\/span><\/p>\n<p><span style=\"font-weight: 400\">The user also misses the opportunity if she never ventures beyond simply \u2018<a href=\"https:\/\/www.youtube.com\/watch?v=9pag8INKl_I\">seeing what happens\u2019 when the system is provoked<\/a>. <\/span><span style=\"font-weight: 400\">Instead, \u2018seeing what happens\u2019 should provide input to the user that prompts a response, rather than functioning as the ultimate output of the system. It is only the first step toward understanding how the system behaves under a wide range of circumstances. <\/span><\/p>\n<p><span style=\"font-weight: 400\">Performers can only achieve full understanding through a methodical exploration that stretches the system well beyond its breaking point.<\/span><span style=\"font-weight: 400\"> Only when the users <\/span><a href=\"https:\/\/en.wikipedia.org\/wiki\/Grok\"><span style=\"font-weight: 400\">grok<\/span><\/a><span style=\"font-weight: 400\"> the system can they begin to \u2018play\u2019 with it through conscientious decision-making. It\u2019s not the sort of casual play that engages through immediate gratification. It\u2019s the highly-skilled kind that you can do with an instrument, the kind that is capable of producing carefully crafted expressive output.<\/span><\/p>\n<h1>Workshopping Interactivity<\/h1>\n<p><span style=\"font-weight: 400\">To begin exploring the choices and relationships afforded by interactive technologies, I recently led a two-day workshop series at Danspace in St. Mark\u2019s Church. I worked to compose sound through choreographic decision-making mediated by technology with a group of 28 dancers, sound artists, and those with no stake in what we were doing other than curiosity. <\/span><\/p>\n<p><span style=\"font-weight: 400\">On one level we were playing with an interactive system that took in movement as input (cause) and generated sound as output (effect). <\/span><\/p>\n<p><span style=\"font-weight: 400\">On another level, though, we were exploring a platform that enables individuals to come together as a group to compose something\u2014in other words, make choices\u2014that is simultaneously a dance and a piece of music.<\/span><\/p>\n<p><span style=\"font-weight: 400\">Overall, we were attempting to turn dancers into composers and composers into both dancers and choreographers, all while trying to master the art of improvisation and the temperamental instrument, which was the interactive system I had created using the Kinect cameras. <\/span><\/p>\n<p><span style=\"font-weight: 400\">The goal of our workshop was to explore a model of interactivity that was psychological rather than technological, playful rather than based on one-sided reactions.<\/span><\/p>\n<p><iframe loading=\"lazy\" title=\"Interactive Dance Workshop with Mimi Yin\" src=\"https:\/\/player.vimeo.com\/video\/257825060?dnt=1&amp;app_id=122963\" width=\"500\" height=\"281\" frameborder=\"0\" allow=\"autoplay; fullscreen; picture-in-picture; clipboard-write\"><\/iframe><\/p>\n<h1>Workshop Takeaways<\/h1>\n<p><span style=\"font-weight: 400\">Is it possible to compose through interaction? Yes. <\/span><\/p>\n<p><span style=\"font-weight: 400\">Did we achieve the level of highly-skilled play required to get there? Sort of. <\/span><\/p>\n<p><span style=\"font-weight: 400\">Though we didn\u2019t even have enough time together for the novelty of playing with the instrument to entirely wear off, we still got remarkably far down the path towards collective composition. Across the five setups we explored, there were many, many moments of \u2018compositional decision-making,\u2019 even if a complete composition never emerged. <\/span><\/p>\n<p><span style=\"font-weight: 400\">To reach such a goal, a dedicated group of practitioners would need to work together daily to find a collective voice and learn how to use it to communicate with the interactive system.<\/span><\/p>\n<p><span style=\"font-weight: 400\">Above all, though, what the participants did learn in the process had more to do with us than our instrument. <\/span><span style=\"font-weight: 400\">Like the stages of romantic love, interactive systems arouse in their human users a series of emotional states that together form a narrative that reveals much more about who we are than how the interactive system works.<\/span><\/p>\n<p><iframe loading=\"lazy\" title=\"Speed Duet\" src=\"https:\/\/player.vimeo.com\/video\/231963893?dnt=1&amp;app_id=122963\" width=\"500\" height=\"281\" frameborder=\"0\" allow=\"autoplay; fullscreen; picture-in-picture; clipboard-write\"><\/iframe><\/p>\n<p><span style=\"font-weight: 400\">The following are the Stages of Interactivity as I observed them in the workshop participants:<\/span><\/p>\n<ol>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Curiosity and the need to figure out how it works<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Followed by a need to be able to control it, however it works<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Followed by an urge to play with it<br \/>\n<\/span><span style=\"font-weight: 400\">\u00a0 \u00a0 \u00a0 \u00a0a. Trick it<br \/>\n<\/span><span style=\"font-weight: 400\">\u00a0 \u00a0 \u00a0 \u00a0b. Break it<br \/>\n<\/span><span style=\"font-weight: 400\">\u00a0 \u00a0 \u00a0 \u00a0c. Make it do nothing<br \/>\n<\/span><span style=\"font-weight: 400\">\u00a0 \u00a0 \u00a0 \u00a0d. Make it do something it&#8217;s not supposed to do<br \/>\n<\/span><span style=\"font-weight: 400\">\u00a0 \u00a0 \u00a0 \u00a0e. Make it do something dramatic<br \/>\n<\/span><span style=\"font-weight: 400\">\u00a0 \u00a0 \u00a0 \u00a0f. Make it do something ridiculous<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Followed by frustration at the inability to gain perfect control over the system<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Followed by acceptance of imperfect control, which finally opened the way for artful conversation with the interactive system (watch:\u00a0<\/span><a href=\"https:\/\/vimeo.com\/231928984\/55a757698f\"><span style=\"font-weight: 400\">Djassi Finale)<\/span><\/a><\/li>\n<\/ol>\n<p><span style=\"font-weight: 400\">Another way to describe the \u2018arc\u2019 of participation would be in terms of focus:<\/span><\/p>\n<ol>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Everyone began with a steadfast, almost obsessive fixation on the cameras. The body always faced the camera, the eyes trained on the laptop screen that shows what the camera sees and the posture crouched as if to make eye contact with the apparatus that sat low on the floor.<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Gradually, focus shifted inward as participants grappled with the internal workings of the system, the logic behind the rules of interaction.<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Eventually, performers directed attention outward as they begin to hear and listen to the sounds, to the music being generated by the system.<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">This was followed by a growing appreciation for the relationship between their own movements and the movements of others around them and how those relationships translated into sonic relationships (watch:\u00a0<\/span><a href=\"https:\/\/vimeo.com\/231963893\/46fdb60ccd\"><span style=\"font-weight: 400\">Speed Duet).<\/span><\/a><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Last, but not least, there came an awareness of the gestalt emerging from individual choices and interactions.<\/span><\/li>\n<\/ol>\n<h1>Conclusions<\/h1>\n<p><span style=\"font-weight: 400\">I began my research asking the rather contrarian question: What\u2019s the point of interactivity in performance if the performer\u2019s choices do not dramatically shape the composition of the work?<\/span><\/p>\n<p><span style=\"font-weight: 400\">The follow-up question to such a question is then, of course: What does it look like for performers to make such choices?<\/span><\/p>\n<p><span style=\"font-weight: 400\">There is no silver bullet answer to this kind of question. Instead the workshop yielded a collection of techniques born of trial and error, in which we treated errors as opportunities rather than something to be avoided or stamped out. <\/span><\/p>\n<p><span style=\"font-weight: 400\">Nevertheless, there are a set overarching principles that will inform the next phase of research:<\/span><\/p>\n<ol>\n<li><span style=\"font-weight: 400\">Work the system until everyone is over the novelty factor of being able to control something through thin air. <\/span><\/li>\n<li><span style=\"font-weight: 400\">Cultivate an expertise in the media you\u2019re interacting with. In our case it was sound. (This sounds obvious but can easily get lost in the heat of getting technology to simply work.)<\/span><\/li>\n<li><span style=\"font-weight: 400\">Master the system warts and all. Treat the warts as opportunities for something unexpected to emerge.<\/span><\/li>\n<li><span style=\"font-weight: 400\">Play with it until the technology becomes transparent. You know this has happened when the focus is no longer on the relationship between the performers and the interactive media (sound) but instead all eyes are on the relationship between the performers and all ears are tuned into the relationship between the sounds.<\/span><\/li>\n<\/ol>\n<p>&nbsp;<\/p>\n<p style=\"text-align: center\"><strong><a href=\"https:\/\/itp.nyu.edu\/~jvc301\/wordpress\/wp-content\/uploads\/2017\/08\/Adjacent_Mimi-recipe.pdf\">&gt;&gt; LEARN THE RECIPE FOR INTERACTIVE COMPOSITION &lt;&lt;<\/a><\/strong><\/p>\n<p>&nbsp;<\/p>\n<p><em>Thanks to Tiriree Kananuruk for help with documentation and curation of sound. Special thanks also to Alexx Shilling and Kat Sullivan for helping me develop the workshop and Tiri&#8217;s documentation team: Mikey Asanin, Vijchika Udomsrianan, Woraya Boonyapanachoti, Wipawe Sirikolkarn, Ratawan Tanadumrongsak. Residency activity is supported through an ongoing partnership between Tisch Initiative for Creative Research and Danspace Project&#8217;s Community ACCESS program.<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Trick it. Break it. Make it do nothing. Make it do something it&#8217;s not supposed to do. <\/p>\n","protected":false},"author":1,"featured_media":1968,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[],"class_list":["post-852","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-issue-2"],"_links":{"self":[{"href":"https:\/\/itp.nyu.edu\/adjacent\/wp-json\/wp\/v2\/posts\/852"}],"collection":[{"href":"https:\/\/itp.nyu.edu\/adjacent\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/itp.nyu.edu\/adjacent\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/itp.nyu.edu\/adjacent\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/itp.nyu.edu\/adjacent\/wp-json\/wp\/v2\/comments?post=852"}],"version-history":[{"count":1,"href":"https:\/\/itp.nyu.edu\/adjacent\/wp-json\/wp\/v2\/posts\/852\/revisions"}],"predecessor-version":[{"id":2376,"href":"https:\/\/itp.nyu.edu\/adjacent\/wp-json\/wp\/v2\/posts\/852\/revisions\/2376"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/itp.nyu.edu\/adjacent\/wp-json\/"}],"wp:attachment":[{"href":"https:\/\/itp.nyu.edu\/adjacent\/wp-json\/wp\/v2\/media?parent=852"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/itp.nyu.edu\/adjacent\/wp-json\/wp\/v2\/categories?post=852"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/itp.nyu.edu\/adjacent\/wp-json\/wp\/v2\/tags?post=852"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}