{"id":4463,"date":"2022-05-10T07:28:33","date_gmt":"2022-05-10T11:28:33","guid":{"rendered":"https:\/\/itp.nyu.edu\/ima\/projects\/sketchchat\/"},"modified":"2022-05-10T07:28:33","modified_gmt":"2022-05-10T11:28:33","slug":"sketchchat","status":"publish","type":"post","link":"https:\/\/itp.nyu.edu\/ima\/sketchchat\/","title":{"rendered":"SketchChat &#8211; Keru Wang"},"content":{"rendered":"<p style=\"text-align: center;\"><em>SketchChat by Keru Wang<\/em><\/p>\n<p style=\"text-align: center;\"><em>Capstone 2022<\/em><\/p>\n<p id=\"project-pitch\" style=\"text-align: center;\">SketchChat: Enhancing Collaboration in Videoconferencing via<br \/>\nBlended Dimensional Interactions.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\" wp-image-4548 aligncenter\" src=\"https:\/\/itp.nyu.edu\/ima\/wp-content\/uploads\/2022\/05\/sketchchat-300x155.png\" alt=\"\" width=\"372\" height=\"192\" \/><\/p>\n<div id=\"project-description\">\n<h3>Description<\/h3>\n<p>Videoconferencing has gained popularity because it is not always feasible for collaborators to meet in person. It is well suited for collaborative 2D tasks such as shared document editing, but lacks the spatial awareness and immersion required for collaborative 3D tasks. To solve this problem, researchers recreate the shared immersive world for remote meetings via dedicated hardware like AR\/VR headsets or using compute-intensive technologies like 3D human reconstruction. This makes the system not easy to access. We propose SketchChat, an immersive online conferencing platform that seamlessly incorporates 2D and 3D multimodal collaborations into a video chat metaphor that requires only a laptop computer. SketchChat renders the collaborators as 2D cropped video feeds collocated in a 3D meeting space, while reconstructing their hands in 3D for intuitive spatial interaction. Features including animated sketching, custom coding and widgets, and object manipulation are supported by multimodal input for smooth multidimensional collaboration.<\/p>\n<h3>Video<\/h3>\n<p><iframe loading=\"lazy\" title=\"IMA Capstone Week 2022: Keru Wang\" src=\"https:\/\/player.vimeo.com\/video\/715874773?dnt=1&amp;app_id=122963\" width=\"500\" height=\"281\" frameborder=\"0\" allow=\"autoplay; fullscreen; picture-in-picture; clipboard-write\"><\/iframe><\/p>\n<\/div>\n<h3><\/h3>\n<h3 id=\"project-course-ids\">Class info<\/h3>\n<div id=\"project-classes\">\n<div id=\"project-course-ids\">IMNY-UT.400.002<\/div>\n<div id=\"project-classes\">Capstone (UG)<\/div>\n<\/div>\n<div id=\"project-keywords\">ToolService<\/div>\n","protected":false},"excerpt":{"rendered":"<p>SketchChat by Keru Wang Capstone 2022 SketchChat: Enhancing Collaboration in Videoconferencing via Blended Dimensional Interactions. Description Videoconferencing has gained popularity because it is not always feasible for collaborators to meet in person. It is well suited for collaborative 2D tasks such as shared document editing, but lacks the spatial awareness and immersion required for collaborative [&hellip;]<\/p>\n","protected":false},"author":14,"featured_media":4939,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[141,17,128],"tags":[],"_links":{"self":[{"href":"https:\/\/itp.nyu.edu\/ima\/wp-json\/wp\/v2\/posts\/4463"}],"collection":[{"href":"https:\/\/itp.nyu.edu\/ima\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/itp.nyu.edu\/ima\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/itp.nyu.edu\/ima\/wp-json\/wp\/v2\/users\/14"}],"replies":[{"embeddable":true,"href":"https:\/\/itp.nyu.edu\/ima\/wp-json\/wp\/v2\/comments?post=4463"}],"version-history":[{"count":0,"href":"https:\/\/itp.nyu.edu\/ima\/wp-json\/wp\/v2\/posts\/4463\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/itp.nyu.edu\/ima\/wp-json\/wp\/v2\/media\/4939"}],"wp:attachment":[{"href":"https:\/\/itp.nyu.edu\/ima\/wp-json\/wp\/v2\/media?parent=4463"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/itp.nyu.edu\/ima\/wp-json\/wp\/v2\/categories?post=4463"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/itp.nyu.edu\/ima\/wp-json\/wp\/v2\/tags?post=4463"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}