https://vimeo.com/418966633

Description

Our project aims to navigate users through our storyline using movements. The setting is the main character commited a suicide and are currently in the ocean. The user will be asked to swim to manipulate a dot with halo on the screen representing the spirit of the character on the brink of life and death. When hitting certain spots on the page, a new webpage will open and the users will be asked to learn some poses like shaking hands and laughing through a piece of memory from when she/he is still alive. After going through all the memory, in the ending page you will be asked to face yourself and use the poses you leared to get out of the sea.

IMA/IMB Shanghai

Movement Practices and Computing

Sound,Art

https://github.com/QianyiChen532/posenet-project

Description

We live in a society where everyone has never been so closely connected. As the butterfly effect suggests, the behavior of each individual can result in a bigger change and eventually transform the reality around us. In (A)synchronous force, a virtual object serves as the metaphor for such a ‘result’ of collective actions. Taking four videos of body movement as the input, the audience experiences how movement gestures apply forces to an object on the screen and together create the movement of the object. The asynchronous videos allow the audience to transcend the limitations of time and space. The visualization of the synchronous interaction attempts to extend the understanding of social interaction and connection.

IMA/IMB Shanghai

Movement Practices and Computing

Art

https://vimeo.com/419782650

Description

We want the experience to have fun experience related to cooking, with added movement (the movements of cooking aren’t very exciting at times). The added movement will be the user having to reach to grab utensils necessary for the recipe. PoseNet will be used so the user can see themselves making the movement.

IMA/IMB Shanghai

INTM-SHU.134.1

Movement Practices and Computing

Accessible

https://vimeo.com/418764392

Description

I attached the IMU to the spinning chair in my room and wrote a program that can draw something based on the spinning of the chair. If I started to run the sketch at the beginning of the day, the final output would be a beautiful art piece. This project can reflect all the subtle motions on your chair. And it would tell you that your daily life is also a piece of art.

IMA/IMB Shanghai

INTM-SHU.134.1

Movement Practices and Computing

Art,Tool\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\Service

https://vimeo.com/418776701

Description

It's an entertaining project using the Posenet to detect the motion of the user and the user can hit the falling letters in the sequence of the alphabet by the wrists. The more letters the user could hit correctly, the more scores the user can get. And the user can compete with other users with the final scores.

IMA/IMB Shanghai

INTM-SHU.134.1

Movement Practices and Computing

Play/Games

https://www.youtube.com/watch?v=WZkyaEmt4Xc&feature=youtu.be

Description

Our main idea is to create an interactive experience for the users to speak out and get rid of their deepest fear in their life. The users will have a chance to physically eliminate their deepest fears by waving their left hand and swipe out those fears. The movement is detected with Posenet. We imported external databases (Google quickdraw dataset) as the fears are portrayed in scribbles. The quick draw dataset is a collection of 50 million drawings across 345 categories. Whenever the user clicks on “draw”, a related object will pop up on the screen. It is not only a fun game but also an interactive art therapy experience.

IMA/IMB Shanghai

INTM-SHU.134.1

Movement Practices and Computing

Art,Machine Learning

https://youtu.be/W8-ARxeKdvI

Description

This is an immersive project that provides a meditating artistic experience using a machine learning model PoseNet. On this website, users' poses will be detected and shown on the screen in an abstract way, with the setting of a night sky. There are twikling stars on the top of the page, and the users could “catch” them. When users touch a particular star, he/she will be presented with a story from the book The Little Prince. There are six stars altogether, in each of them is one chapter from The Little Prince. There would be text on the page, along with a voice narrative and the backgroud music. The project aims to navigate people through a dreamy journey.

IMA/IMB Shanghai

INTM-SHU.134.1

Movement Practices and Computing

Art,Narrative/Storytelling

https://www.youtube.com/watch?v=N6_7t8bXNfo

Description

Using our bodies to draw isn’t something new, but using our bodies to create a moving world on the canvas is. For this project, I would like to create a work called “poseCreate”. In poseCreate, users can imitate the objects they would like to draw and the animation of the object they imitate will appear on the canvas, therefore they are able to create a moving image on the canvas.

IMA/IMB Shanghai

INTM-SHU.134.1

Movement Practices and Computing

Art,Machine Learning

https://vimeo.com/418311690

Description

Rhythm, or 律 in Chinese, means both the pattern of things and the rhythm of sound. In this project, we aim to explore the rhythm of body movement and how can it be integrated into the computer graphics. The hand gesture and body movement of the dancer guide the movement and change of the pattern, the pattern in return communicates with the dancer while maintaining its own rhythm.

IMA/IMB Shanghai

INTM-SHU.134.1

Movement Practices and Computing

Performance,Art

https://youtu.be/BSoG0NdBP6k

Description

Overall it is a posenet project. In this project, players need to adjust their posture to get into the next challenge. The outline of posture they need to do will be shown on screen. Players will be given time to adjust their posture. If players touch the limit of the posture or their posture is not standardized enough, their AP will be eliminated. When AP reaches 0, the game's over.

I use Posenet to catch the player's movement real-time. If technically allowed, I may develop multi-players mode in the future.

The original idea came from the TV show I watched when I was young. There was a wall made of foam board moving to the player and the player needed to adjust their pose before the wall hit them. I tried make the image move but I failed:D Actually the project is not stable enough, but it can be played haha. Hope you have fun~

IMA/IMB Shanghai

INTM-SHU.134.1

Movement Practices and Computing

Performance,Play/Games