Epiphany

Retrive your love for yourself in the journey of epiphany through a series of movements.

Mia Fan, Jannie Zhou

https://vimeo.com/418966633

Description

Our project aims to navigate users through our storyline using movements. The setting is the main character commited a suicide and are currently in the ocean. The user will be asked to swim to manipulate a dot with halo on the screen representing the spirit of the character on the brink of life and death. When hitting certain spots on the page, a new webpage will open and the users will be asked to learn some poses like shaking hands and laughing through a piece of memory from when she/he is still alive. After going through all the memory, in the ending page you will be asked to face yourself and use the poses you leared to get out of the sea.

IMA/IMB Shanghai
Movement Practices and Computing
Sound,Art

(A)synchronous Force

Transcending the limitations of time and space, what will the result of the interactions of (a)synchronous force look like?

Qianyi Chen

https://github.com/QianyiChen532/posenet-project

Description

We live in a society where everyone has never been so closely connected. As the butterfly effect suggests, the behavior of each individual can result in a bigger change and eventually transform the reality around us. In (A)synchronous force, a virtual object serves as the metaphor for such a ‘result’ of collective actions. Taking four videos of body movement as the input, the audience experiences how movement gestures apply forces to an object on the screen and together create the movement of the object. The asynchronous videos allow the audience to transcend the limitations of time and space. The visualization of the synchronous interaction attempts to extend the understanding of social interaction and connection.

IMA/IMB Shanghai
Movement Practices and Computing
Art

Chef to Chef

Experiment with the movement in relation to a screen, while engaging with the familiar scene of cooking!

Emily Wright, Echo Chi

https://vimeo.com/419782650

Description

We want the experience to have fun experience related to cooking, with added movement (the movements of cooking aren’t very exciting at times). The added movement will be the user having to reach to grab utensils necessary for the recipe. PoseNet will be used so the user can see themselves making the movement.

IMA/IMB Shanghai
INTM-SHU.134.1
Movement Practices and Computing
Accessible

Art on a Chair

It's an artistic project that draws your day on your spinning chair.

Joseph Yang

https://vimeo.com/418764392

Description

I attached the IMU to the spinning chair in my room and wrote a program that can draw something based on the spinning of the chair. If I started to run the sketch at the beginning of the day, the final output would be a beautiful art piece. This project can reflect all the subtle motions on your chair. And it would tell you that your daily life is also a piece of art.

IMA/IMB Shanghai
INTM-SHU.134.1
Movement Practices and Computing
Art,Tool\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\Service

Hit the Letter

It's a game that you can hit the letters in the sequence of the alphabet by using your wrists.

Joseph Yang

https://vimeo.com/418776701

Description

It's an entertaining project using the Posenet to detect the motion of the user and the user can hit the falling letters in the sequence of the alphabet by the wrists. The more letters the user could hit correctly, the more scores the user can get. And the user can compete with other users with the final scores.

IMA/IMB Shanghai
INTM-SHU.134.1
Movement Practices and Computing
Play/Games

White Night

White Night presents an interactive experience for the users to speak out and get rid of their deepest fear in their life.

Anica Yao, Jamie Wang

https://www.youtube.com/watch?v=WZkyaEmt4Xc&feature=youtu.be

Description

Our main idea is to create an interactive experience for the users to speak out and get rid of their deepest fear in their life. The users will have a chance to physically eliminate their deepest fears by waving their left hand and swipe out those fears. The movement is detected with Posenet. We imported external databases (Google quickdraw dataset) as the fears are portrayed in scribbles. The quick draw dataset is a collection of 50 million drawings across 345 categories. Whenever the user clicks on “draw”, a related object will pop up on the screen. It is not only a fun game but also an interactive art therapy experience.

IMA/IMB Shanghai
INTM-SHU.134.1
Movement Practices and Computing
Art,Machine Learning

Catch the Stars

Catch the stars here and go through a beautiful archive for The Little Prince's memory.

Jannie Zhou

https://youtu.be/W8-ARxeKdvI

Description

This is an immersive project that provides a meditating artistic experience using a machine learning model PoseNet. On this website, users' poses will be detected and shown on the screen in an abstract way, with the setting of a night sky. There are twikling stars on the top of the page, and the users could “catch” them. When users touch a particular star, he/she will be presented with a story from the book The Little Prince. There are six stars altogether, in each of them is one chapter from The Little Prince. There would be text on the page, along with a voice narrative and the backgroud music. The project aims to navigate people through a dreamy journey.

IMA/IMB Shanghai
INTM-SHU.134.1
Movement Practices and Computing
Art,Narrative/Storytelling

poseCreate

Create drawings by posing them out!

Jamie Wang

https://www.youtube.com/watch?v=N6_7t8bXNfo

Description

Using our bodies to draw isn’t something new, but using our bodies to create a moving world on the canvas is. For this project, I would like to create a work called “poseCreate”. In poseCreate, users can imitate the objects they would like to draw and the animation of the object they imitate will appear on the canvas, therefore they are able to create a moving image on the canvas.

IMA/IMB Shanghai
INTM-SHU.134.1
Movement Practices and Computing
Art,Machine Learning

Rhythm

When the rhythm of dancer and computer graphics communicate with each other.

Qianyi Chen, Joseph Yang

https://vimeo.com/418311690

Description

Rhythm, or 律 in Chinese, means both the pattern of things and the rhythm of sound. In this project, we aim to explore the rhythm of body movement and how can it be integrated into the computer graphics. The hand gesture and body movement of the dancer guide the movement and change of the pattern, the pattern in return communicates with the dancer while maintaining its own rhythm.

IMA/IMB Shanghai
INTM-SHU.134.1
Movement Practices and Computing
Performance,Art

PoseChallenge

Make the pose as shown on the screen to enter next level!

Mia Fan

https://youtu.be/BSoG0NdBP6k

Description

Overall it is a posenet project. In this project, players need to adjust their posture to get into the next challenge. The outline of posture they need to do will be shown on screen. Players will be given time to adjust their posture. If players touch the limit of the posture or their posture is not standardized enough, their AP will be eliminated. When AP reaches 0, the game's over.

I use Posenet to catch the player's movement real-time. If technically allowed, I may develop multi-players mode in the future.

The original idea came from the TV show I watched when I was young. There was a wall made of foam board moving to the player and the player needed to adjust their pose before the wall hit them. I tried make the image move but I failed:D Actually the project is not stable enough, but it can be played haha. Hope you have fun~

IMA/IMB Shanghai
INTM-SHU.134.1
Movement Practices and Computing
Performance,Play/Games