Abstract

Miscommunication is a critical issue that can greatly affect the experience and efficiency of co-creation. In the context of the increasingly popular 3D technology, real-time visual feedback can be generated according to co-creation descriptions, allowing for further discussions based on concrete results. However, individuals without relevant backgrounds or those who experience physical issues such as wrist pain may not be able to effectively use traditional mouse-based modeling tools. Consequently, it is important to develop alternative approaches to ensure that co-creation is inclusive and accessible to everyone, regardless of prior 3D modeling knowledge or skills. Through research and behavior observation, it was found that individuals without an art or design background tend to describe 3D appearance vaguely through verbal language and gestures. To address this issue, a human-machine collaboration 3D modeling approach was proposed, designed, and developed. To ensure the future development of this approach, potential goals for further research and development are identified based on the current human-machine collaboration solution and other experiments with applicable technologies.

Research

Technical Details

JavaScript; WebGL; 3D; NLP; CV; Python; 3D Printing