{"id":1777,"date":"2025-05-29T21:26:50","date_gmt":"2025-05-29T13:26:50","guid":{"rendered":"https:\/\/tongjicdi.com\/?p=1777"},"modified":"2025-05-29T22:38:25","modified_gmt":"2025-05-29T14:38:25","slug":"gencomui-exploring-generative-visual-aids-as-medium-to-support-task-oriented-human-robot-communication","status":"publish","type":"post","link":"https:\/\/tongjicdi.com\/index.php\/2025\/05\/29\/gencomui-exploring-generative-visual-aids-as-medium-to-support-task-oriented-human-robot-communication\/","title":{"rendered":"GenComUI: Exploring Generative Visual Aids as Medium to Support Task-Oriented Human-Robot Communication"},"content":{"rendered":"\t\t<div data-elementor-type=\"wp-post\" data-elementor-id=\"1777\" class=\"elementor elementor-1777\" data-elementor-post-type=\"post\">\n\t\t\t\t<div class=\"elementor-element elementor-element-1678c0cb e-flex e-con-boxed e-con e-parent\" data-id=\"1678c0cb\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-18d81166 elementor-widget elementor-widget-theme-post-featured-image elementor-widget-image\" data-id=\"18d81166\" data-element_type=\"widget\" data-widget_type=\"theme-post-featured-image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<style>\/*! elementor - v3.22.0 - 24-06-2024 *\/\n.elementor-widget-image{text-align:center}.elementor-widget-image a{display:inline-block}.elementor-widget-image a img[src$=\".svg\"]{width:48px}.elementor-widget-image img{vertical-align:middle;display:inline-block}<\/style>\t\t\t\t\t\t\t\t\t\t<img fetchpriority=\"high\" decoding=\"async\" width=\"800\" height=\"290\" src=\"https:\/\/tongjicdi.com\/wp-content\/uploads\/2025\/05\/Capture-2025-05-29-212405-1024x371.png\" class=\"attachment-large size-large wp-image-1785\" alt=\"\" srcset=\"https:\/\/tongjicdi.com\/wp-content\/uploads\/2025\/05\/Capture-2025-05-29-212405-1024x371.png 1024w, https:\/\/tongjicdi.com\/wp-content\/uploads\/2025\/05\/Capture-2025-05-29-212405-300x109.png 300w, https:\/\/tongjicdi.com\/wp-content\/uploads\/2025\/05\/Capture-2025-05-29-212405-768x278.png 768w, https:\/\/tongjicdi.com\/wp-content\/uploads\/2025\/05\/Capture-2025-05-29-212405-1536x556.png 1536w, https:\/\/tongjicdi.com\/wp-content\/uploads\/2025\/05\/Capture-2025-05-29-212405.png 1693w\" sizes=\"(max-width: 800px) 100vw, 800px\" \/>\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-1e625ea7 elementor-widget elementor-widget-theme-post-title elementor-page-title elementor-widget-heading\" data-id=\"1e625ea7\" data-element_type=\"widget\" data-widget_type=\"theme-post-title.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<style>\/*! elementor - v3.22.0 - 24-06-2024 *\/\n.elementor-heading-title{padding:0;margin:0;line-height:1}.elementor-widget-heading .elementor-heading-title[class*=elementor-size-]>a{color:inherit;font-size:inherit;line-height:inherit}.elementor-widget-heading .elementor-heading-title.elementor-size-small{font-size:15px}.elementor-widget-heading .elementor-heading-title.elementor-size-medium{font-size:19px}.elementor-widget-heading .elementor-heading-title.elementor-size-large{font-size:29px}.elementor-widget-heading .elementor-heading-title.elementor-size-xl{font-size:39px}.elementor-widget-heading .elementor-heading-title.elementor-size-xxl{font-size:59px}<\/style><h1 class=\"elementor-heading-title elementor-size-default\">GenComUI: Exploring Generative Visual Aids as Medium to Support Task-Oriented Human-Robot Communication<\/h1>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-1816f459 elementor-widget elementor-widget-text-editor\" data-id=\"1816f459\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<style>\/*! elementor - v3.22.0 - 24-06-2024 *\/\n.elementor-widget-text-editor.elementor-drop-cap-view-stacked .elementor-drop-cap{background-color:#69727d;color:#fff}.elementor-widget-text-editor.elementor-drop-cap-view-framed .elementor-drop-cap{color:#69727d;border:3px solid;background-color:transparent}.elementor-widget-text-editor:not(.elementor-drop-cap-view-default) .elementor-drop-cap{margin-top:8px}.elementor-widget-text-editor:not(.elementor-drop-cap-view-default) .elementor-drop-cap-letter{width:1em;height:1em}.elementor-widget-text-editor .elementor-drop-cap{float:left;text-align:center;line-height:1;font-size:50px}.elementor-widget-text-editor .elementor-drop-cap-letter{display:inline-block}<\/style>\t\t\t\t<p><span role=\"listitem\"><span class=\"dropBlock\">Yate\u00a0Ge<\/span><\/span>, <span role=\"listitem\"><span class=\"dropBlock\">Meiying\u00a0Li<\/span><\/span>, <span role=\"listitem\"><span class=\"dropBlock\">Xipeng\u00a0Huang<\/span><\/span>, <span role=\"listitem\"><span class=\"dropBlock\">Yuanda\u00a0Hu<\/span><\/span><span data-hidden-on=\"sm\">, <span role=\"listitem\"><span class=\"dropBlock\">Qi\u00a0Wang<\/span><\/span><\/span><span data-hidden-on=\"sm\">, <span role=\"listitem\"><span class=\"dropBlock\">Xiaohua\u00a0Sun<\/span><\/span><\/span><span data-hidden-on=\"sm\">, <span role=\"listitem\"><span class=\"dropBlock\">Weiwei\u00a0Guo<\/span><\/span><\/span><\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-1f0608ab elementor-widget elementor-widget-text-editor\" data-id=\"1f0608ab\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>CHI&#8217;25<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-68aaee85 e-flex e-con-boxed e-con e-parent\" data-id=\"68aaee85\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-3cc082cc elementor-widget elementor-widget-heading\" data-id=\"3cc082cc\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">\u6458\u8981\/Abstract<\/h2>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-1c48a8fa e-flex e-con-boxed e-con e-parent\" data-id=\"1c48a8fa\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t<div class=\"elementor-element elementor-element-c04c2ad e-con-full e-flex e-con e-child\" data-id=\"c04c2ad\" data-element_type=\"container\">\n\t\t\t\t<div class=\"elementor-element elementor-element-263e6961 elementor-widget elementor-widget-text-editor\" data-id=\"263e6961\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>\u8fd9\u9879\u5de5\u4f5c\u7814\u7a76\u4e86\u5728\u4eba\u673a\u4efb\u52a1\u901a\u4fe1\u4e2d\u96c6\u6210\u751f\u6210\u6027\u89c6\u89c9\u8f85\u52a9\u5de5\u5177\u7684\u53ef\u884c\u6027\u3002\u6211\u4eec\u5f00\u53d1\u4e86 GenComUI \u7cfb\u7edf\uff0c\u8be5\u7cfb\u7edf\u7531\u5927\u578b\u8bed\u8a00\u6a21\u578b\uff08LLMs\uff09\u9a71\u52a8\uff0c\u80fd\u591f\u52a8\u6001\u751f\u6210\u4e0a\u4e0b\u6587\u76f8\u5173\u7684\u89c6\u89c9\u8f85\u52a9\u5de5\u5177\u2014\u2014\u5982\u5730\u56fe\u6ce8\u91ca\u3001\u8def\u5f84\u6307\u793a\u5668\u548c\u52a8\u753b\u2014\u2014\u4ee5\u652f\u6301\u53e3\u5934\u4efb\u52a1\u901a\u4fe1\u5e76\u4fc3\u8fdb\u4e3a\u673a\u5668\u4eba\u751f\u6210\u5b9a\u5236\u5316\u4efb\u52a1\u7a0b\u5e8f\u3002\u8be5\u7cfb\u7edf\u7684\u8bbe\u8ba1\u7075\u611f\u6765\u6e90\u4e8e\u4e00\u9879\u5f62\u6210\u6027\u7814\u7a76\uff0c\u8be5\u7814\u7a76\u63a2\u8ba8\u4e86\u4eba\u7c7b\u5982\u4f55\u4f7f\u7528\u5916\u90e8\u89c6\u89c9\u5de5\u5177\u6765\u8f85\u52a9\u7a7a\u95f4\u4efb\u52a1\u4e2d\u7684\u53e3\u5934\u901a\u4fe1\u3002\u4e3a\u4e86\u8bc4\u4f30\u5176\u6709\u6548\u6027\uff0c\u6211\u4eec\u8fdb\u884c\u4e86\u4e00\u9879\u7528\u6237\u5b9e\u9a8c\uff08n=20\uff09\uff0c\u5c06 GenComUI \u4e0e\u4ec5\u8bed\u97f3\u57fa\u7ebf\u8fdb\u884c\u6bd4\u8f83\u3002\u7ed3\u679c\u8868\u660e\uff0c\u751f\u6210\u6027\u89c6\u89c9\u8f85\u52a9\u5de5\u5177\u901a\u8fc7\u5b9a\u6027\u548c\u5b9a\u91cf\u5206\u6790\uff0c\u901a\u8fc7\u63d0\u4f9b\u6301\u7eed\u7684\u89c6\u89c9\u53cd\u9988\uff0c\u589e\u5f3a\u4e86\u53e3\u5934\u4efb\u52a1\u901a\u4fe1\uff0c\u4ece\u800c\u4fc3\u8fdb\u4e86\u81ea\u7136\u6709\u6548\u7684\u673a\u5668\u4eba\u901a\u4fe1\u3002\u6b64\u5916\uff0c\u8be5\u7814\u7a76\u8fd8\u63d0\u4f9b\u4e86\u4e00\u7ec4\u8bbe\u8ba1\u542f\u793a\uff0c\u5f3a\u8c03\u4e86\u52a8\u6001\u751f\u6210\u7684\u89c6\u89c9\u8f85\u52a9\u5de5\u5177\u5728\u4eba\u673a\u4ea4\u4e92\u4e2d\u4f5c\u4e3a\u6709\u6548\u901a\u4fe1\u5a92\u4ecb\u7684\u4f5c\u7528\u3002 \u8fd9\u4e9b\u53d1\u73b0\u5f3a\u8c03\u4e86\u751f\u6210\u6027\u89c6\u89c9\u8f85\u52a9\u5de5\u5177\u5728\u8bbe\u8ba1\u66f4\u76f4\u89c2\u548c\u6709\u6548\u7684\u673a\u5668\u4eba\u901a\u4fe1\u65b9\u9762\u7684\u6f5c\u529b\uff0c\u7279\u522b\u662f\u5728\u4eba\u7c7b\u4e0e\u673a\u5668\u4eba\u4ea4\u4e92\u4ee5\u53ca\u57fa\u4e8e LLM \u7684\u6700\u7ec8\u7528\u6237\u5f00\u53d1\u4e2d\u7684\u590d\u6742\u901a\u4fe1\u573a\u666f\u4e2d\u3002<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-7917e602 e-con-full e-flex e-con e-child\" data-id=\"7917e602\" data-element_type=\"container\">\n\t\t\t\t<div class=\"elementor-element elementor-element-14a1cd52 elementor-widget elementor-widget-text-editor\" data-id=\"14a1cd52\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\tThis work investigates the integration of generative visual aids in human-robot task communication. We developed GenComUI, a system powered by large language models (LLMs) that dynamically generates contextual visual aids\u2014such as map annotations, path indicators, and animations\u2014to support verbal task communication and facilitate the generation of customized task programs for the robot. This system was informed by a formative study that examined how humans use external visual tools to assist verbal communication in spatial tasks. To evaluate its effectiveness, we conducted a user experiment (n = 20) comparing GenComUI with a voice-only baseline. The results demonstrate that generative visual aids, through both qualitative and quantitative analysis, enhance verbal task communication by providing continuous visual feedback, thus promoting natural and effective human-robot communication. Additionally, the study offers a set of design implications, emphasizing how dynamically generated visual aids can serve as an effective communication medium in human-robot interaction. These findings underscore the potential of generative visual aids to inform the design of more intuitive and effective human-robot communication, particularly for complex communication scenarios in human-robot interaction and LLM-based end-user development.\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-19b4fcb9 e-flex e-con-boxed e-con e-parent\" data-id=\"19b4fcb9\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-2daae3c7 elementor-widget elementor-widget-spacer\" data-id=\"2daae3c7\" data-element_type=\"widget\" data-widget_type=\"spacer.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<style>\/*! elementor - v3.22.0 - 24-06-2024 *\/\n.elementor-column .elementor-spacer-inner{height:var(--spacer-size)}.e-con{--container-widget-width:100%}.e-con-inner>.elementor-widget-spacer,.e-con>.elementor-widget-spacer{width:var(--container-widget-width,var(--spacer-size));--align-self:var(--container-widget-align-self,initial);--flex-shrink:0}.e-con-inner>.elementor-widget-spacer>.elementor-widget-container,.e-con>.elementor-widget-spacer>.elementor-widget-container{height:100%;width:100%}.e-con-inner>.elementor-widget-spacer>.elementor-widget-container>.elementor-spacer,.e-con>.elementor-widget-spacer>.elementor-widget-container>.elementor-spacer{height:100%}.e-con-inner>.elementor-widget-spacer>.elementor-widget-container>.elementor-spacer>.elementor-spacer-inner,.e-con>.elementor-widget-spacer>.elementor-widget-container>.elementor-spacer>.elementor-spacer-inner{height:var(--container-widget-height,var(--spacer-size))}.e-con-inner>.elementor-widget-spacer.elementor-widget-empty,.e-con>.elementor-widget-spacer.elementor-widget-empty{position:relative;min-height:22px;min-width:22px}.e-con-inner>.elementor-widget-spacer.elementor-widget-empty .elementor-widget-empty-icon,.e-con>.elementor-widget-spacer.elementor-widget-empty .elementor-widget-empty-icon{position:absolute;top:0;bottom:0;left:0;right:0;margin:auto;padding:0;width:22px;height:22px}<\/style>\t\t<div class=\"elementor-spacer\">\n\t\t\t<div class=\"elementor-spacer-inner\"><\/div>\n\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-3360dab0 e-flex e-con-boxed e-con e-parent\" data-id=\"3360dab0\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-383808c5 elementor-widget elementor-widget-heading\" data-id=\"383808c5\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">\u76f8\u5173\u4fe1\u606f\/Info<\/h2>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-cc9a476 e-flex e-con-boxed e-con e-parent\" data-id=\"cc9a476\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t<div class=\"elementor-element elementor-element-1e55b682 e-con-full e-flex e-con e-child\" data-id=\"1e55b682\" data-element_type=\"container\">\n\t\t\t\t<div class=\"elementor-element elementor-element-53966f46 elementor-widget elementor-widget-heading\" data-id=\"53966f46\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">\u4f5c\u8005\/Authors<br><\/h2>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-3c003e24 elementor-widget elementor-widget-heading\" data-id=\"3c003e24\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">\u94fe\u63a5\/Link<\/h2>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-20e55220 e-con-full e-flex e-con e-child\" data-id=\"20e55220\" data-element_type=\"container\">\n\t\t\t\t<div class=\"elementor-element elementor-element-54715601 elementor-widget elementor-widget-text-editor\" data-id=\"54715601\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p><span role=\"listitem\"><span class=\"dropBlock\">Yate\u00a0Ge<\/span><\/span>, <span role=\"listitem\"><span class=\"dropBlock\">Meiying\u00a0Li<\/span><\/span>, <span role=\"listitem\"><span class=\"dropBlock\">Xipeng\u00a0Huang<\/span><\/span>, <span role=\"listitem\"><span class=\"dropBlock\">Yuanda\u00a0Hu<\/span><\/span><span data-hidden-on=\"sm\">, <span role=\"listitem\"><span class=\"dropBlock\">Qi\u00a0Wang<\/span><\/span><\/span><span data-hidden-on=\"sm\">, <span role=\"listitem\"><span class=\"dropBlock\">Xiaohua\u00a0Sun<\/span><\/span><\/span><span data-hidden-on=\"sm\">, <span role=\"listitem\"><span class=\"dropBlock\">Weiwei\u00a0Guo<\/span><\/span><\/span><\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-383bf9a5 elementor-widget elementor-widget-text-editor\" data-id=\"383bf9a5\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>https:\/\/dl.acm.org\/doi\/10.1145\/3706598.3714238<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-7ab4832e e-flex e-con-boxed e-con e-parent\" data-id=\"7ab4832e\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-2ff8c5b1 elementor-widget elementor-widget-spacer\" data-id=\"2ff8c5b1\" data-element_type=\"widget\" data-widget_type=\"spacer.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<div class=\"elementor-spacer\">\n\t\t\t<div class=\"elementor-spacer-inner\"><\/div>\n\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-1e39b81c e-flex e-con-boxed e-con e-parent\" data-id=\"1e39b81c\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-60aed1f8 elementor-widget elementor-widget-spacer\" data-id=\"60aed1f8\" data-element_type=\"widget\" data-widget_type=\"spacer.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<div class=\"elementor-spacer\">\n\t\t\t<div class=\"elementor-spacer-inner\"><\/div>\n\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-1ea51776 e-flex e-con-boxed e-con e-parent\" data-id=\"1ea51776\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-474583d elementor-widget elementor-widget-heading\" data-id=\"474583d\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">\u56fe\u7247\/Figures<\/h2>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-473c7732 e-flex e-con-boxed e-con e-parent\" data-id=\"473c7732\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-2b9388b8 elementor-widget elementor-widget-gallery\" data-id=\"2b9388b8\" data-element_type=\"widget\" data-settings=\"{&quot;gallery_layout&quot;:&quot;masonry&quot;,&quot;columns&quot;:2,&quot;gap&quot;:{&quot;unit&quot;:&quot;px&quot;,&quot;size&quot;:20,&quot;sizes&quot;:[]},&quot;lazyload&quot;:&quot;yes&quot;,&quot;columns_tablet&quot;:2,&quot;columns_mobile&quot;:1,&quot;gap_tablet&quot;:{&quot;unit&quot;:&quot;px&quot;,&quot;size&quot;:10,&quot;sizes&quot;:[]},&quot;gap_mobile&quot;:{&quot;unit&quot;:&quot;px&quot;,&quot;size&quot;:10,&quot;sizes&quot;:[]},&quot;link_to&quot;:&quot;file&quot;,&quot;overlay_background&quot;:&quot;yes&quot;,&quot;content_hover_animation&quot;:&quot;fade-in&quot;}\" data-widget_type=\"gallery.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<style>\/*! elementor-pro - v3.22.0 - 24-06-2024 *\/\n.elementor-gallery__container{min-height:1px}.elementor-gallery-item{position:relative;overflow:hidden;display:block;text-decoration:none;border:solid var(--image-border-width) var(--image-border-color);border-radius:var(--image-border-radius)}.elementor-gallery-item__content,.elementor-gallery-item__overlay{height:100%;width:100%;position:absolute;top:0;left:0}.elementor-gallery-item__overlay{mix-blend-mode:var(--overlay-mix-blend-mode);transition-duration:var(--overlay-transition-duration);transition-property:mix-blend-mode,transform,opacity,background-color}.elementor-gallery-item__image.e-gallery-image{transition-duration:var(--image-transition-duration);transition-property:filter,transform}.elementor-gallery-item__content{display:flex;flex-direction:column;justify-content:var(--content-justify-content,center);align-items:center;text-align:var(--content-text-align);padding:var(--content-padding)}.elementor-gallery-item__content>div{transition-duration:var(--content-transition-duration)}.elementor-gallery-item__content.elementor-gallery--sequenced-animation>div:nth-child(2){transition-delay:calc(var(--content-transition-delay) \/ 3)}.elementor-gallery-item__content.elementor-gallery--sequenced-animation>div:nth-child(3){transition-delay:calc(var(--content-transition-delay) \/ 3 * 2)}.elementor-gallery-item__content.elementor-gallery--sequenced-animation>div:nth-child(4){transition-delay:calc(var(--content-transition-delay) \/ 3 * 3)}.elementor-gallery-item__description{color:var(--description-text-color,#fff);width:100%}.elementor-gallery-item__title{color:var(--title-text-color,#fff);font-weight:700;width:100%}.elementor-gallery__titles-container{display:flex;flex-wrap:wrap;justify-content:var(--titles-container-justify-content,center);margin-bottom:20px}.elementor-gallery__titles-container:not(.e--pointer-framed) .elementor-item:after,.elementor-gallery__titles-container:not(.e--pointer-framed) .elementor-item:before{background-color:var(--galleries-pointer-bg-color-hover)}.elementor-gallery__titles-container:not(.e--pointer-framed) .elementor-item.elementor-item-active:after,.elementor-gallery__titles-container:not(.e--pointer-framed) .elementor-item.elementor-item-active:before{background-color:var(--galleries-pointer-bg-color-active)}.elementor-gallery__titles-container.e--pointer-framed .elementor-item:before{border-color:var(--galleries-pointer-bg-color-hover);border-width:var(--galleries-pointer-border-width)}.elementor-gallery__titles-container.e--pointer-framed .elementor-item:after{border-color:var(--galleries-pointer-bg-color-hover)}.elementor-gallery__titles-container.e--pointer-framed .elementor-item.elementor-item-active:after,.elementor-gallery__titles-container.e--pointer-framed .elementor-item.elementor-item-active:before{border-color:var(--galleries-pointer-bg-color-active)}.elementor-gallery__titles-container.e--pointer-framed.e--animation-draw .elementor-item:before{border-left-width:var(--galleries-pointer-border-width);border-bottom-width:var(--galleries-pointer-border-width);border-right-width:0;border-top-width:0}.elementor-gallery__titles-container.e--pointer-framed.e--animation-draw .elementor-item:after{border-left-width:0;border-bottom-width:0;border-right-width:var(--galleries-pointer-border-width);border-top-width:var(--galleries-pointer-border-width)}.elementor-gallery__titles-container.e--pointer-framed.e--animation-corners .elementor-item:before{border-left-width:var(--galleries-pointer-border-width);border-bottom-width:0;border-right-width:0;border-top-width:var(--galleries-pointer-border-width)}.elementor-gallery__titles-container.e--pointer-framed.e--animation-corners .elementor-item:after{border-left-width:0;border-bottom-width:var(--galleries-pointer-border-width);border-right-width:var(--galleries-pointer-border-width);border-top-width:0}.elementor-gallery__titles-container .e--pointer-double-line .elementor-item:after,.elementor-gallery__titles-container .e--pointer-double-line .elementor-item:before,.elementor-gallery__titles-container .e--pointer-overline .elementor-item:before,.elementor-gallery__titles-container .e--pointer-underline .elementor-item:after{height:var(--galleries-pointer-border-width)}.elementor-gallery-title{--space-between:10px;cursor:pointer;color:#6d7882;font-weight:500;position:relative;padding:7px 14px;transition:all .3s}.elementor-gallery-title--active{color:#495157}.elementor-gallery-title:not(:last-child){margin-inline-end:var(--space-between)}.elementor-gallery-item__title+.elementor-gallery-item__description{margin-top:var(--description-margin-top)}.e-gallery-item.elementor-gallery-item{transition-property:all}.e-gallery-item.elementor-animated-content .elementor-animated-item--enter-from-bottom,.e-gallery-item.elementor-animated-content .elementor-animated-item--enter-from-left,.e-gallery-item.elementor-animated-content .elementor-animated-item--enter-from-right,.e-gallery-item.elementor-animated-content .elementor-animated-item--enter-from-top,.e-gallery-item:focus .elementor-gallery__item-overlay-bg,.e-gallery-item:focus .elementor-gallery__item-overlay-content,.e-gallery-item:focus .elementor-gallery__item-overlay-content__description,.e-gallery-item:focus .elementor-gallery__item-overlay-content__title,.e-gallery-item:hover .elementor-gallery__item-overlay-bg,.e-gallery-item:hover .elementor-gallery__item-overlay-content,.e-gallery-item:hover .elementor-gallery__item-overlay-content__description,.e-gallery-item:hover .elementor-gallery__item-overlay-content__title{opacity:1}a.elementor-item.elementor-gallery-title{color:var(--galleries-title-color-normal)}a.elementor-item.elementor-gallery-title.elementor-item-active,a.elementor-item.elementor-gallery-title.highlighted,a.elementor-item.elementor-gallery-title:focus,a.elementor-item.elementor-gallery-title:hover{color:var(--galleries-title-color-hover)}a.elementor-item.elementor-gallery-title.elementor-item-active{color:var(--gallery-title-color-active)}.e-con-inner>.elementor-widget-gallery,.e-con>.elementor-widget-gallery{width:var(--container-widget-width);--flex-grow:var(--container-widget-flex-grow)}<\/style>\t\t<div class=\"elementor-gallery__container\">\n\t\t\t\t\t\t\t<a class=\"e-gallery-item elementor-gallery-item elementor-animated-content\" href=\"https:\/\/tongjicdi.com\/wp-content\/uploads\/2025\/05\/Capture-2025-05-29-212532.png\" data-elementor-open-lightbox=\"no\">\n\t\t\t\t\t<div class=\"e-gallery-image elementor-gallery-item__image\" data-thumbnail=\"https:\/\/tongjicdi.com\/wp-content\/uploads\/2025\/05\/Capture-2025-05-29-212532.png\" data-width=\"1286\" data-height=\"552\" aria-label=\"\" role=\"img\" ><\/div>\n\t\t\t\t\t\t\t\t\t\t\t<div class=\"elementor-gallery-item__overlay\"><\/div>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/a>\n\t\t\t\t\t\t\t<a class=\"e-gallery-item elementor-gallery-item elementor-animated-content\" href=\"https:\/\/tongjicdi.com\/wp-content\/uploads\/2025\/05\/Capture-2025-05-29-212405.png\" data-elementor-open-lightbox=\"no\">\n\t\t\t\t\t<div class=\"e-gallery-image elementor-gallery-item__image\" data-thumbnail=\"https:\/\/tongjicdi.com\/wp-content\/uploads\/2025\/05\/Capture-2025-05-29-212405.png\" data-width=\"1693\" data-height=\"613\" aria-label=\"\" role=\"img\" ><\/div>\n\t\t\t\t\t\t\t\t\t\t\t<div class=\"elementor-gallery-item__overlay\"><\/div>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/a>\n\t\t\t\t\t\t\t<a class=\"e-gallery-item elementor-gallery-item elementor-animated-content\" href=\"https:\/\/tongjicdi.com\/wp-content\/uploads\/2025\/05\/Capture-2025-05-29-212550.png\" data-elementor-open-lightbox=\"no\">\n\t\t\t\t\t<div class=\"e-gallery-image elementor-gallery-item__image\" data-thumbnail=\"https:\/\/tongjicdi.com\/wp-content\/uploads\/2025\/05\/Capture-2025-05-29-212550.png\" data-width=\"819\" data-height=\"528\" aria-label=\"\" role=\"img\" ><\/div>\n\t\t\t\t\t\t\t\t\t\t\t<div class=\"elementor-gallery-item__overlay\"><\/div>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/a>\n\t\t\t\t\t\t\t<a class=\"e-gallery-item elementor-gallery-item elementor-animated-content\" href=\"https:\/\/tongjicdi.com\/wp-content\/uploads\/2025\/05\/Capture-2025-05-29-212447.png\" data-elementor-open-lightbox=\"no\">\n\t\t\t\t\t<div class=\"e-gallery-image elementor-gallery-item__image\" data-thumbnail=\"https:\/\/tongjicdi.com\/wp-content\/uploads\/2025\/05\/Capture-2025-05-29-212447.png\" data-width=\"1699\" data-height=\"852\" aria-label=\"\" role=\"img\" ><\/div>\n\t\t\t\t\t\t\t\t\t\t\t<div class=\"elementor-gallery-item__overlay\"><\/div>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/a>\n\t\t\t\t\t\t\t<a class=\"e-gallery-item elementor-gallery-item elementor-animated-content\" href=\"https:\/\/tongjicdi.com\/wp-content\/uploads\/2025\/05\/Capture-2025-05-29-212431.png\" data-elementor-open-lightbox=\"no\">\n\t\t\t\t\t<div class=\"e-gallery-image elementor-gallery-item__image\" data-thumbnail=\"https:\/\/tongjicdi.com\/wp-content\/uploads\/2025\/05\/Capture-2025-05-29-212431.png\" data-width=\"1697\" data-height=\"975\" aria-label=\"\" role=\"img\" ><\/div>\n\t\t\t\t\t\t\t\t\t\t\t<div class=\"elementor-gallery-item__overlay\"><\/div>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/a>\n\t\t\t\t\t\t\t<a class=\"e-gallery-item elementor-gallery-item elementor-animated-content\" href=\"https:\/\/tongjicdi.com\/wp-content\/uploads\/2025\/05\/Capture-2025-05-29-212420.png\" data-elementor-open-lightbox=\"no\">\n\t\t\t\t\t<div class=\"e-gallery-image elementor-gallery-item__image\" data-thumbnail=\"https:\/\/tongjicdi.com\/wp-content\/uploads\/2025\/05\/Capture-2025-05-29-212420.png\" data-width=\"1630\" data-height=\"1039\" aria-label=\"\" role=\"img\" ><\/div>\n\t\t\t\t\t\t\t\t\t\t\t<div class=\"elementor-gallery-item__overlay\"><\/div>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/a>\n\t\t\t\t\t\t\t<a class=\"e-gallery-item elementor-gallery-item elementor-animated-content\" href=\"https:\/\/tongjicdi.com\/wp-content\/uploads\/2025\/05\/Capture-2025-05-29-212542.png\" data-elementor-open-lightbox=\"no\">\n\t\t\t\t\t<div class=\"e-gallery-image elementor-gallery-item__image\" data-thumbnail=\"https:\/\/tongjicdi.com\/wp-content\/uploads\/2025\/05\/Capture-2025-05-29-212542.png\" data-width=\"1734\" data-height=\"440\" aria-label=\"\" role=\"img\" ><\/div>\n\t\t\t\t\t\t\t\t\t\t\t<div class=\"elementor-gallery-item__overlay\"><\/div>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/a>\n\t\t\t\t\t\t\t<a class=\"e-gallery-item elementor-gallery-item elementor-animated-content\" href=\"https:\/\/tongjicdi.com\/wp-content\/uploads\/2025\/05\/Capture-2025-05-29-212456.png\" data-elementor-open-lightbox=\"no\">\n\t\t\t\t\t<div class=\"e-gallery-image elementor-gallery-item__image\" data-thumbnail=\"https:\/\/tongjicdi.com\/wp-content\/uploads\/2025\/05\/Capture-2025-05-29-212456.png\" data-width=\"845\" data-height=\"354\" aria-label=\"\" role=\"img\" ><\/div>\n\t\t\t\t\t\t\t\t\t\t\t<div class=\"elementor-gallery-item__overlay\"><\/div>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/a>\n\t\t\t\t\t<\/div>\n\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"<p>This work investigates the integration of generative visual aids in human-robot task communication. We developed GenComUI, a system powered by large language models (LLMs) that dynamically generates contextual visual aids\u2014such as map annotations, path indicators, and animations\u2014to support verbal task communication and facilitate the generation of customized task programs for the robot. This system was informed by a formative study that examined how humans use external visual tools to assist verbal communication in spatial tasks. To evaluate its effectiveness, we conducted a user experiment (n = 20) comparing GenComUI with a voice-only baseline. The results demonstrate that generative visual aids, through both qualitative and quantitative analysis, enhance verbal task communication by providing continuous visual feedback, thus promoting natural and effective human-robot communication. Additionally, the study offers a set of design implications, emphasizing how dynamically generated visual aids can serve as an effective communication medium in human-robot interaction. These findings underscore the potential of generative visual aids to inform the design of more intuitive and effective human-robot communication, particularly for complex communication scenarios in human-robot interaction and LLM-based end-user development.<\/p>\n","protected":false},"author":1,"featured_media":1785,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[28,27,13],"tags":[],"class_list":["post-1777","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai","category-hri","category-13"],"_links":{"self":[{"href":"https:\/\/tongjicdi.com\/index.php\/wp-json\/wp\/v2\/posts\/1777","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/tongjicdi.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/tongjicdi.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/tongjicdi.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/tongjicdi.com\/index.php\/wp-json\/wp\/v2\/comments?post=1777"}],"version-history":[{"count":7,"href":"https:\/\/tongjicdi.com\/index.php\/wp-json\/wp\/v2\/posts\/1777\/revisions"}],"predecessor-version":[{"id":1858,"href":"https:\/\/tongjicdi.com\/index.php\/wp-json\/wp\/v2\/posts\/1777\/revisions\/1858"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/tongjicdi.com\/index.php\/wp-json\/wp\/v2\/media\/1785"}],"wp:attachment":[{"href":"https:\/\/tongjicdi.com\/index.php\/wp-json\/wp\/v2\/media?parent=1777"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/tongjicdi.com\/index.php\/wp-json\/wp\/v2\/categories?post=1777"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/tongjicdi.com\/index.php\/wp-json\/wp\/v2\/tags?post=1777"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}