Posted on

poseCreate

Create drawings by posing them out!

Jamie Wang

https://www.youtube.com/watch?v=N6_7t8bXNfo

Description

Using our bodies to draw isn’t something new, but using our bodies to create a moving world on the canvas is. For this project, I would like to create a work called “poseCreate”. In poseCreate, users can imitate the objects they would like to draw and the animation of the object they imitate will appear on the canvas, therefore they are able to create a moving image on the canvas.

IMA/IMB Shanghai
INTM-SHU.134.1
Movement Practices and Computing
Art,Machine Learning
Posted on

Rhythm

When the rhythm of dancer and computer graphics communicate with each other.

Qianyi Chen, Joseph Yang

https://vimeo.com/418311690

Description

Rhythm, or 律 in Chinese, means both the pattern of things and the rhythm of sound. In this project, we aim to explore the rhythm of body movement and how can it be integrated into the computer graphics. The hand gesture and body movement of the dancer guide the movement and change of the pattern, the pattern in return communicates with the dancer while maintaining its own rhythm.

IMA/IMB Shanghai
INTM-SHU.134.1
Movement Practices and Computing
Performance,Art
Posted on

Extend Steaming

Yet another dimension of interaction you may enjoy while streaming.

Wenhe Li

https://youtu.be/PR42Sxhw9O4

Description

Nowadays, the interaction in live streaming is limited to verbal comments either on top of the content or at the side. However, streaming as entertainment, its content should be a joint effort of both the streamer and the audience. This project aims to find a new medium that could primarily extend the interaction dimension while streaming and watching streaming content. Therefore, Augmented Reality (AR) will be the ideal medium for streamers and audience in this project.

In detail, this project will add three interactions:

1) Tap & Text. It is like traditional verbal comments, but users(audience & streamers) can leave comments on any physical location. In this way, the comments should have a stronger connection to the surroundings/context.

2) Tap & Place. It is like the Tap & Text, but it places 3D models. Later, I want to make those models interactable to users by just getting the user's figure gestures from the camera.

3) Tap & Play. Instead of placing models and texts, this interaction will place multimedia(Video, Gif, and even other Streaming Content) to the physical location. The above two forms of interaction aim to connect the streamer and audience by offering a mutual interactable item ob both sides.

The whole idea of this project is to bring more dimensions to the live streaming interaction system and allow more audience to engage in the streaming content. As T.L Taylor comments on live-streaming by saying, “It is a form that plays with the boundary lines between audience and producer.” I hope this project could show the futuristic view of what audience-oriented live streaming could be.

IMA/IMB Shanghai
INTM-SHU.401.3
Capstone Studio (Shanghai)
Mobile,VR/AR
Posted on

PoseChallenge

Make the pose as shown on the screen to enter next level!

Mia Fan

https://youtu.be/BSoG0NdBP6k

Description

Overall it is a posenet project. In this project, players need to adjust their posture to get into the next challenge. The outline of posture they need to do will be shown on screen. Players will be given time to adjust their posture. If players touch the limit of the posture or their posture is not standardized enough, their AP will be eliminated. When AP reaches 0, the game's over.

I use Posenet to catch the player's movement real-time. If technically allowed, I may develop multi-players mode in the future.

The original idea came from the TV show I watched when I was young. There was a wall made of foam board moving to the player and the player needed to adjust their pose before the wall hit them. I tried make the image move but I failed:D Actually the project is not stable enough, but it can be played haha. Hope you have fun~

IMA/IMB Shanghai
INTM-SHU.134.1
Movement Practices and Computing
Performance,Play/Games
Posted on

Escape Room Flashlight

Use this flashlight to play Escape Room

Linda Li

https://www.youtube.com/watch?v=7EOU984ezTk

Description

“Escape Room” is a video game consisting of a controller which looks like a flashlight, allowing players to navigate multiple virtual rooms on screen. A player is locked in a room when the game starts. Only when the player collects all the clues from the room can proceed to the next room to escape the rooms in the end. Built with Arduino and Processing, players interact with the game using the two knobs and a button on the flashlight controller, replacing the conventional mode of playing a game. Clues will show up when both intensity value and halo size value are a correct range. To help users make correct adjustments, there are hints on the upper left corner suggesting whether the two values are in correct range or not. In addition, this game uses images and theme music from Harry Potter to create a more immersive experience. Hope you have a pleasant journey.

IMA/IMB Shanghai
INTM-SHU.101.4
Interaction Lab
Play/Games
Posted on

Music Interaction Game

Click mouse or press keyboard to interact with the game.

Linda Li

https://youtu.be/_5mpz8SGahg

Description

“Music Interaction Game”is a music game consisting of keyboard interaction and background music. By pressing any key on the keyboard, user can hit notes on the screen and get a certain number of scores. To start the game, users can click the “START” button on the upper left corner. This button will trigger background music. There will be notes floating on staves at the bottom as long as the music starts to play. Different from other music games, this game is totally for entertainment and relaxation, which means it’s much easier for users to attain a higher score. Hope this game can release your pressure and provide you a pleasant experience.

IMA/IMB Shanghai
INTM-SHU.135.1
Creative Coding Lab
Music,Play/Games
Posted on

Spying The Moon

This project visualizes the TR R-277 report, also know as Nasa’s Chronological Catalog of Reported Lunar Events, and try to interpret this dataset with its historic background the “Space War”.

Lishan Qin

https://lq455.github.io./

Description

The dataset I visualize is Nasa’s Chronological Catalog of Reported Lunar Events released in 1968, also known as the TR R-277 report. It was at that time the single most complete report of all observed lunar anomalies. It lists 536 pieces of records from 1500 till 1967 that include the date, the location, and the description of the reported abnormal lunar event observed from the earth. From the dataset, I can see a significant rise in the number of records after the Cold War began, the time when the historic event “Space Race” took place. Through the visualization of this report, my project intends to highlight the rise of the number of records during the Cold War to show the United States’ devotion to the “Space Race” and potentially their paranoia about being outdone in the race to the moon during the Cold War. While the TR R-277 may seem like an insignificant aspect of the US’s efforts in the “Space Race”, it is still a rather important project. By recording the Nasa’s observation of the abnormal events happening on the moon, it had helped the NASA to understand the moon, observe what they and their enemy are doing on the moon, and also to imagine what they and their enemy could do on the moon. After researching about the context and history of this data, I think that this dataset can show us three possible historic features. Firstly, the founding of NASA gradually contributes to the number of people devoted to the observation of the activity on the moon, which made the number of records at that time increase. Secondly, the tension of the race to the moon during the cold war had led to more research satellites sent to the moon which not only made the detected range on the moon wider but also made the number of detected activities increase. Thirdly, America's paranoia about the activities on the moon for fear of being surpassed in the space war has made their observation more careful and thorough. Thus, in my opinion, this dataset could reflect America’s devotion and passion about the moon during the time of the “Space Race”.

IMA/IMB Shanghai
INTM-SHU.204.1
Critical Data & Visualization
Narrative/Storytelling
Posted on

Emojified Social Media

A research that processes English tweets with emojis and a data visualization on the use of Emojis on twitter, with regard to Sentiment, Spam, Combination & Position.

Chengyu Zhang

https://mstxy.github.io/Emojified-Social-Media/

Description

The project is based on a raw dataset of 18 million unprocessed English tweets with at least one emojis, as well as a file about the how these emojis are used in Twitter: how many are used in positive, neutral and negative tweets.

  For the analyze of the data, I calculated the sentiment score for each emoji – if it is used more in negative tweets, then it is more negative than positive. Then, using Python's VADER and NLTK library, I get the text sentiment for each tweet. Other than that, I processed the data to get the average Position of each emoji, Combinations of emojis in each text, the number of times one emoji is Spammed in each text.

  Therefore, for the project, it is a visualization of my result of the research mainly using d3.js library. It includes five different interactive graphs, each represents one aspect of my result.

  Hope you enjoy it！

IMA/IMB Shanghai
INTM-SHU.204.1
Critical Data & Visualization
Narrative/Storytelling
Posted on

家: An Art Book on Intergenerational Trauma

“家” is a multimedia art book that chronicles my experience with intergenerational trauma within my Chinese American family.

Maya Yanjie Wang

https://youtu.be/hejROfwPtnA

Description

My book exposes and chronicles intergenerational trauma within my Chinese American family. Three generations of my family’s history are recounted through interviews, poetry, photos, and paintings. Topics such as parent/child relationships, domestic abuse, mourning, and diaspora are addressed. I created this book not only to document and spark discussion about difficult and painful familial relationships, but also to reconcile my own experiences in an act of catharsis. The narrative progresses and regresses in a nonlinear way to reflect the true process of healing.

I invite viewers to interact with my work and think about their own experiences in tandem. Discussing family trauma is stigmatized, and when left unresolved, trauma manifests in dysfunction that is inherited by the next generation. The conception of this project stemmed from a desire to reconcile my own experiences, but it has developed into the creation of a metaphorical space where people can discuss and reflect on the shared issues and experiences of a minority identity. Art that comes from an honest and personal place has the ability to resonate with people and be a medium for self-reflection – despite the deeply varied human experience – because of universal themes.

IMA/IMB Shanghai
INTM-SHU.401.1
Capstone Studio (Shanghai)
Art,Narrative/Storytelling
Posted on

Map of Songci 宋词地图

An interactive map project connecting cities in China with Chinese poetry.

Sumner Feng

https://youtu.be/xk7pPF5Os8k

Description

The map of Songci is a web-based interactive map project. The project focuses on the cities appeared in Songci and picks out representative ones to make visualizations. As for interactive functions, this project includes diverse sound, art, and story elements. Aiming at providing an interactive experience for users to pursue a better understanding of this poetry style associated with the history of the Song Dynasty, this project will connect the historical information of cities to the map of Song to introduce diverse aspects and stories of Song Ci and the Song Dynasty.

(The loading of the music could take a while, please wait until the music starts and then begin exploring.)

IMA/IMB Shanghai
INTM-SHU.204.1
Critical Data & Visualization
Culture,Art