数字创新中心

Center for Digital Innovation

Co-Design of Service Robot Applications Using Virtual Reality

Yate Ge, Yuanda Hu, Xiaohua Sun

Human Factors in Virtual Environments and Game Design (2023)

摘要/Abstract

服务机器人的应用场景越来越多,包括家庭、医院、办公室、学校、酒店等。为保证交互界面和过程在服务机器人应用中的可用性,服务机器人应用中的人机交互设计涉及各种交互方式、不同的机器人形态、机器人在空间中的不同物理行为等。这使得在服务机器人应用程序设计的早期阶段拥有支持设计探索的低成本、高保真原型方法变得具有挑战性。目前,许多快速原型制作技术已应用于服务机器人应用设计中的设计探索阶段,例如纸质原型、故事板、视频原型等。但是,这些方法存在局限性,包括低保真度和脱离环境环境。研究人员还一直在探索新的原型方法,以满足 HRI 设计的设计探索和测试要求。一些研究探讨了 VR 测试 HRI 原型的使用,其中大多数侧重于技术方面和 HRI 功能的性能。其他研究侧重于特定的 HRI 设计方面:交互机制、拟人化外观、社会接受度等。专注于这些方面的方法不适用于对服务机器人应用程序的整体交互场景进行原型设计和测试。本文基于虚拟现实技术的特点,旨在探讨如何利用虚拟现实技术来支持虚拟环境中服务机器人应用的多用户协同设计。 为了解决这个问题,本文提出了一种支持服务机器人应用协同设计的系统。本文将详细介绍系统框架和实现。具体来说,该系统使多个用户(设计师或利益相关者)能够使用头戴式 VR 设备实时进入虚拟环境。用户可以根据目标应用场景选择合适的环境模型资产,并在“现场”进行 bodystorming。使用模块化机器人构建工具,用户可以将虚拟机器人添加到空间并添加或删除功能组件,以及调整组件的位置、大小和方向。该系统的 Wizard-of-OZ 模块允许用户控制机器人的运动和组件状态。Graphic UI 通过 WebView 嵌入到机器人的物理显示中,并支持 Graphic UI 交互过程的模拟。在完成初始应用概念构思和虚拟机器人设计后,用户可以使用 WoZ 和 Role-Playing 技术进行人机交互过程,以评估和优化交互设计。此外,演出的录制视频也可以支持后续的设计讨论。该系统使用 Unity 游戏引擎实现,用户使用 Oculus Quest 耳机和控制器与系统交互。将评估和讨论基于该系统的设计活动案例,以分析该系统的优势和劣势。此外,我们讨论了这项工作的局限性以及支持使用虚拟现实设计服务机器人应用的未来研究方向。

Service robots have been applied in an increasing number of scenarios, including homes, hospitals, offices, schools, hotels, etc. To ensure the usability of the interaction interface and process in the application of service robots, the design of human-robot interaction in the application of service robots involves various interaction modalities, different robot forms, and different physical behaviors of robots in space, etc. This makes it challenging to have low-cost, high-fidelity prototype methods that support design exploration in the early stages of service robot application design.Currently, many rapid prototyping techniques have been applied to the design exploration stage in the design of service robot applications, such as paper prototypes, storyboards, video prototypes, etc. However, these methods have limitations, including low fidelity and being out of the environmental context. Researchers have also been exploring new prototype methods to meet the design exploration and testing requirements for HRI design. Some studies have explored the use of VR test HRI prototypes, and most of them focus on the technical aspect, and the performance of HRI capabilities. Other studies focus on specific HRI design aspects: interactive mechanism, anthropomorphic appearance, social acceptance, and so on. Approaches focusing on these aspects are not suitable for prototyping and testing the overall interaction scenarios of service robot applications.Based on the characteristics of virtual reality technology, this paper aims to explore how virtual reality technology can be used to support multi-user collaborative design of service robot applications in a virtual environment. To address this issue, this paper proposes a system for supporting collaborative design of service robot applications. The system framework and implementation will be described in detail in the paper. Specifically, the system enables multiple users (designers or stakeholders) to enter a virtual environment in real-time using head-mounted VR devices. Users can select appropriate environment model assets based on the target application scenario and perform bodystorming “on site”. Using a modular robot building tool, users can add virtual robots to the space and add or delete functional components, as well as adjust the position, size, and orientation of the components. The system’s Wizard-of-OZ module allows users to control the robot’s movement and component status. The Graphic UI is embedded into the physical display of the robot via WebView and supports the simulation of the Graphic UI interaction process. After completing the initial application concept ideation and virtual robot design, users can use WoZ and Role-Playing techniques to perform the human-robot interaction process to evaluate and optimize the interaction design. In addition, the recorded video of the performance can also support subsequent design discussions.The system is implemented using the Unity game engine, and users interact with the system using the Oculus Quest headsets and controllers. The design activities case based on the system will be evaluated and discussed to analyze the strengths and weaknesses of the system. Further, we discuss the limitations of this work and the future research directions for supporting the design of service robot applications using virtual reality.

相关信息/Info

作者/Authors

链接/Link

Yate Ge, Yuanda Hu, Xiaohua Sun

https://openaccess.cms-conferences.org/publications/book/978-1-958651-72-8/article/978-1-958651-72-8_7

图片/Figures