SketchChat – Keru Wang
SketchChat by Keru Wang
Capstone 2022
SketchChat: Enhancing Collaboration in Videoconferencing via
Blended Dimensional Interactions.
Description
Videoconferencing has gained popularity because it is not always feasible for collaborators to meet in person. It is well suited for collaborative 2D tasks such as shared document editing, but lacks the spatial awareness and immersion required for collaborative 3D tasks. To solve this problem, researchers recreate the shared immersive world for remote meetings via dedicated hardware like AR/VR headsets or using compute-intensive technologies like 3D human reconstruction. This makes the system not easy to access. We propose SketchChat, an immersive online conferencing platform that seamlessly incorporates 2D and 3D multimodal collaborations into a video chat metaphor that requires only a laptop computer. SketchChat renders the collaborators as 2D cropped video feeds collocated in a 3D meeting space, while reconstructing their hands in 3D for intuitive spatial interaction. Features including animated sketching, custom coding and widgets, and object manipulation are supported by multimodal input for smooth multidimensional collaboration.
Video
Class info
Recent Posts
Recent Comments
Categories
- Abby Ausmus
- Accessible
- Allison Parrish
- Apoorva Ramakrishnan
- Art
- Blair Simmons
- Capstone
- Capstone (UG)
- Christshon Harris
- Chuning Sun
- Collective Narrative (UG)
- Community
- Culture
- Dongxu Xie
- Education
- Ethan Printz
- Faith Zeng
- Grace Lila Redman
- Han Ning Damon Chen
- Health
- Installation
- James Baffour
- Jasmine Sun
- Jianhao Ma
- Keru Wang
- Korin Sayers
- Leon Liu
- Lilian Yang
- Lyujiang Chen
- Machine Learning
- Marianne Petit
- Mobile
- Narrative/Storytelling
- Peiling Jiang
- Performance
- Play/Games
- Product Design
- Projects
- Robert Ye
- Roopa Vasudevan
- Sama Srinivas
- Service
- Siyuan Peng
- Social Good/Activism
- social software
- Sound
- Speculative/Futures
- stoker kou
- Tech & Society
- Tool
- ToolService
- Topics in Fabrication: Introduction to Digital Fabrication (UG)
- Tori DelValle
- Tyler Burrell
- Uncategorized
- UX/UI Design
- VRAR
- Wearables
- Weiyi He
- Xinda Ma
- Xuemei Yang
- Yiming Chen
- Zijian Lu
Categories
- Abby Ausmus (1)
- Accessible (1)
- Allison Parrish (12)
- Apoorva Ramakrishnan (1)
- Art (10)
- Blair Simmons (1)
- Capstone (3)
- Capstone (UG) (26)
- Christshon Harris (1)
- Chuning Sun (1)
- Collective Narrative (UG) (1)
- Community (2)
- Culture (6)
- Dongxu Xie (1)
- Education (3)
- Ethan Printz (1)
- Faith Zeng (2)
- Grace Lila Redman (1)
- Han Ning Damon Chen (1)
- Health (3)
- Installation (6)
- James Baffour (1)
- Jasmine Sun (1)
- Jianhao Ma (1)
- Keru Wang (1)
- Korin Sayers (1)
- Leon Liu (1)
- Lilian Yang (1)
- Lyujiang Chen (1)
- Machine Learning (3)
- Marianne Petit (1)
- Mobile (1)
- Narrative/Storytelling (8)
- Peiling Jiang (2)
- Performance (3)
- Play/Games (6)
- Product Design (4)
- Projects (32)
- Robert Ye (1)
- Roopa Vasudevan (9)
- Sama Srinivas (1)
- Service (2)
- Siyuan Peng (1)
- Social Good/Activism (1)
- social software (1)
- Sound (2)
- Speculative/Futures (1)
- stoker kou (1)
- Tech & Society (2)
- Tool (2)
- ToolService (2)
- Topics in Fabrication: Introduction to Digital Fabrication (UG) (1)
- Tori DelValle (1)
- Tyler Burrell (1)
- Uncategorized (1)
- UX/UI Design (2)
- VRAR (4)
- Wearables (3)
- Weiyi He (1)
- Xinda Ma (2)
- Xuemei Yang (1)
- Yiming Chen (1)
- Zijian Lu (1)