3D flower model with some edges and vertices
Accessibility Art Machine learning Tool/Service


A human-machine collaborative 3D modeling approach enables non-professional individuals to co-create 3D models using words and gestures, addressing accessibility and pain-related issues in traditional 3D modeling and empowering everyone to create 3D to shape the future.


Zoe Cai


Sharon De La Cruz


Miscommunication is a critical issue that can greatly affect the experience and efficiency of co-creation. In the context of the increasingly popular 3D technology, real-time visual feedback can be generated according to co-creation descriptions, allowing for further discussions based on concrete results. However, individuals without relevant backgrounds or those who experience physical issues such as wrist pain may not be able to effectively use traditional mouse-based modeling tools. Consequently, it is important to develop alternative approaches to ensure that co-creation is inclusive and accessible to everyone, regardless of prior 3D modeling knowledge or skills. Through research and behavior observation, it was found that individuals without an art or design background tend to describe 3D appearance vaguely through verbal language and gestures. To address this issue, a human-machine collaboration 3D modeling approach was proposed, designed, and developed. To ensure the future development of this approach, potential goals for further research and development are identified based on the current human-machine collaboration solution and other experiments with applicable technologies.

3D flower model with some edges and vertices


Technical Details

JavaScript; WebGL; 3D; NLP; CV; Python; 3D Printing