Category: Projects

Posted on

VIBROTACTILE

An instrument that can feel the music with vibrations for the hearing impaired

Keunjung Bae

https://vimeo.com/491830031

Description

In general, music is perceived as art by sound, and we think that if there is a problem with hearing, we will not be able to hear it. Beethoven, a composer who became deaf in his later years, can be viewed with pity, but on the contrary, it can be seen as a human victory overcoming adversity.

But, just because they can't hear music on their ears, Does it mean they can't play music at all? The important thing is that the source of sound is vibration.Then, even if we can't feel the vibration with our ears, we would it be possible to feel it with other organs of our body.

When listening to a low sound through a loud speaker in a place like club, we can experience the vibrations all over our body. This is a stimulus that can be sensed by a person with a hearing problem because the transmitted stimulus is felt by other sensory organs as well as the ear.

The purpose of this 'VIBROTACTILE' project is a device that makes it possible to recognize and feel music through tactile experiences through vibrations for the hearing impaired.

How would the world of music look like through the sound of strings transmitted to the fingers through several vibrating motors?

VIBROTACTILE makes them feel the music through vibration through the sense of tactile transmitted to the strings through vibration motors. Through the vibration of the motor that vibrates automatically according to the song of the p5 sketch, we can check which keyboard of the p5 sketch video connected with the vibrating motor is what note. Therefore, even if we can not listen to the piano sound, we can check which note is played with only the vibration.

project webstie: http://www.keunjungbae.com/2020/12/09/pcom-week-14/

ITPG-GT.2301.00002
Intro to Phys. Comp.
Education,Accessible
Posted on

Soundrop

A poetic interactive painting of rain that reflects the viewers through splendid colors

Bei Hu, Junoh Yu

https://www.youtube.com/watch?v=My7IVEd98w0&feature=emb_title

Description

“Soundrop” is a poetic interactive painting of rain that reflects the viewer through splendid colors. In this piece, we focused on ‘rain’ and ‘meditation’. So through conversation, we decided to write a poem about rain as a part of the process of making. We tried hard to create a relaxing and meditative visual-sound experience for the viewer. Through using PoseNet and Webcam, we can capture the viewer’s position and present the shape of the viewer with rain. When the viewer stands in front of the P5.js painting with rain falling from the top, the white raindrops turn into rainbow colors as soon as they pass through the viewer’s body outline. The changing color of rain will be updated according to the body movement of the viewer. The speed of the rain and the volume of the rain sound could be changed according to the position of the viewer's body. We want people to experience the rain in a new way as they are standing in the rain, and listening to our self-written poems. (Co-created by Junoh Yu and Bei Hu)

ITPG-GT.2233.00007
ICM
Sound,Narrative/Storytelling
Posted on

Musical Garden

Make music by tending to a virtual garden.

Elias Jarzombek

https://vimeo.com/488997563

Description

This web instrument allows you to make music by planting and watering different kinds of “audio seeds” that grow into lush melodies and textures.

Watering the seeds causes them to grow both visually and sonically, and distinct areas in the garden cause the plants to behave in different ways.

Composing using this interface is more spacial than linear. Plants emanate sound that you navigate through using the mouse, so moving through the space influences the mix of sounds.

The implementation represents different types of sound using basic geometric forms and generates growth patterns algorithmically using L-Systems — a way of modeling generational systems. These patterns are at times also used to produce melodies.

The musical garden invites exploration, and can be found at https://musical-garden.netlify.app/

ITPG-GT.2653.00001, ITPG-GT.2048.00004
The Code of Music, ICM – Media
Sound,Music
Posted on

Doodle!

Exploring unique pen tools to draw with in an online canvas.

Abby Lee

https://youtu.be/kZ5JpsCC2Wc

Description

Inspired by the term “casual creator”, an alternate design space for tools which support creativity as a pleasurable activity rather than to accomplish tasks, I wanted to reimagine how to make drawing fun. Doodling is a past-time that has no specific outcome, so I channeled that into these pens. These pens were designed for users to feel wonder and curiosity about how they work, while also having fun exploring an online canvas. The blending pen is an exploration of shapes, textures and colors. The DNA pen is designed to be a fun introduction into science, with the idea of using DNA as a means of storing and transferring information.

ITPG-GT.2068.001
Hand Held: Creative Tools for Phones
Art,Mobile
Posted on

BankHeist

Pulling off a “Bank Heist” remotely by signing in real-time

Jason Tse

https://www.youtube.com/watch?v=6OJlWO6G2lc

Description

BankHeist is a network interface that makes remote signing possible. Imagine you are in a situation that requires you to sign a physical document overseas, possibly for banking or legal purposes, but your tight schedule or cost of travel restricts you from leaving your current location. Especially during a pandemic, it becomes impossible to travel abroad to finish such a task in a safe fashion.

This is where BankHeist comes into play. By gathering the signer and the receiver in the same secure virtual signing room, utilizing Socket.io and Crypto.js, the digital signature/strokes on the signer end will be transferred to the receiver's end. Once the receiver's computer receives the signature data, it will be translated into serial commands which then drives the AxiDraw machine over a USB connection, to essentially turn the digital signals into a physical signature on a piece of paper. When the signing session is being conducted, the receiver and signer will be connected with a video conference call (e.g. Zoom) to prove their physical presents while the signature is being sent over the internet. Not only it eliminates the physical distance restriction, but it also adds an extra layer of security to the entire signature process. It is far more secure than digital signature solutions available in the market, for instance, “DocuSign”, where users can easily replicate a signature, or sign for another person if they have access to the signer's computer.

ITPG-GT.2808.001
Understanding Networks
Tool\\\\Service,Privacy/Security
Posted on

Smart Tiles

A letter block board with text-to-speech engine designed for tangible learning.

Brandon Roots

https://vimeo.com/489237628

Description

Smart Tiles is a block board that recognizes wooden letter tiles to generate speech and play games. It operates entirely offline. The project was designed with my 4 year old niece and nephew in mind. They both enjoy playing with educational smartphone apps but I had a hard time finding any really compelling educational tangible toys for learning letters and words. This is my attempt to fill that gap. The letter tiles are designed to be familiar, like the wooden alphabet blocks I had growing up, and CNC milled from eco friendly Green-T Birch plywood. I have pushed to make the technology as “invisible” as possible to bring some magic to the user experience. Both English Braille and print characters are engraved on each block to be inclusive for tangible learners.

ITPG-GT.2845.001, ITPG-GT.2301.00005, ITPG-GT.2048.00002, ITPG-GT.2536.00001
Prototyping Electronic Devices , Intro to Phys. Comp., ICM – Media, Programming from A to Z (Online)
Education,Play/Games
Posted on

CHOCOLATE FACTORY

Do you fancy some chocolate?

Chenyan Yu, Jane Meng, Zhiyue Huang

https://youtu.be/CZI2s5pUyp0

Description

With the finals approaching, do you find yourself feeling down or eagerly need some rest? Are you uncousiously tapping your table out of anxiety? Now, we've created a good place to vent your negative emotion, and… Turn these feelings into something sweet, such as chocolate! In our chocolate factory, we take users' tapping pattern as input, do a rough classification of emotion, and generate a chocolate recipe accordingly. Tah-dah! Time for a tea break!

ITPG-GT.2301.00008
Intro to Phys. Comp.
Health,Product Design
Posted on

A Shining Tree

This project aims to create a poetic and embodied experience of nature and growth by letting people grow shining trees using their body.

Chenyan Yu, , Zairan Liu

https://youtu.be/EweHTKCm43M

Description

The Shining Tree combines Posenet to detect human and p5.js for the growing tree itself. Our purpose is to remind people the magical and beautiful nature and its amazing arrangement of the circle of life and at the same time, make it a calm and peaceful process for people to experience by themselves as a way of meditation and reflection. In the chaotic time of Covid-19, not only social interactions are partially impeded, but our connection to nature. A shining tree seems to be a great solution to the anxiety we are facing now and can help us to reconnect with the most basic yet wonderful experience of living and the hope it carries within the circle of life.

ITPG-GT.2233.00007
ICM
Narrative/Storytelling,Play/Games
Posted on

Don't Worry About That

A haunting and dystopian look at the cloud, Don't Worry About That is a performance by everyone's favorite voice assistant, Siri.

Dawn Sinkowski

https://vimeo.com/477738821

Description

A haunting and dystopian look at the cloud, Don't Worry About That is a performance by everyone's favorite voice assistant, Siri. The cloud, omnipresent and weightless, hanging above us all but actually mired in the earth. What does this light connectivity bring us? And what does it take away? A video collage is set to William Basinski's Disintegration Loop 1.1, Don't Worry About That tells a story through found footage.

ITPG-GT.2156.001
Socially Engaged Art and Digital Practice
Culture,Art
Posted on

Text2Video

Text2Video is a software tool that converts text to video for a more engaging learning experience.

Zack Lee

https://vimeo.com/489223504

Description

Text2Video is a software tool that converts text to video for a more engaging learning experience.

I started this project because during this semester, I have been given many reading assignments and I felt frustration in reading long text. For me, it was very time and energy consuming to learn something through reading. So I imagined, “What if there was a tool that turns text into something more engaging such as a video, wouldn't it improve my learning experience?”

I did some research and found a number of articles and studies supporting that videos can be more effective in learning than text for many people including the following data:

– The human brain can process visuals 60,000 times faster than text.

– Viewers retain 95% of a video’s message compared to 10% when reading text.

– 65% of people consider themselves to be visual learners.

I created a prototype web application that takes text as an input and generates a video as an output.

I plan to further work on the project targeting young college students who are aged between 18 to 23 because they tend to prefer learning through videos over books based on the survey I found.

The technologies I used for the project are HTML, CSS, Javascript, Node.js, CCapture.js, ffmpegserver.js, Amazon Polly, Python, Flask, gevent, spaCy, and Pixabay API.

Application link: https://text-to-video.herokuapp.com/

Demo Video: https://vimeo.com/489223504

Github repository: https://github.com/cuinjune/text2video

ITPG-GT.2988.001, ITPG-GT.2075.001, ITPG-GT.2778.00001
Hello, Computer: Unconventional Uses of Voice Technology , Imagination and Distributed Learning (Online), Reading and Writing Electronic Text (Online)
Education,Tool\Service