English

应用科学学报 ›› 2023, Vol. 41 ›› Issue (1): 71-79.doi: 10.3969/j.issn.0255-8297.2023.01.006

• 计算机应用专辑 • 上一篇    下一篇

力触觉增强的虚拟现实工厂系统

徐文彪1,2,3,4, 许驰2,3,4, 史洪岩1, 李琳3,4   

  1. 1. 沈阳化工大学 信息工程学院, 辽宁 沈阳 110142;
    2. 中国科学院 网络化控制系统重点实验室, 辽宁 沈阳 110016;
    3. 中国科学院 沈阳自动化研究所, 辽宁 沈阳 110016;
    4. 中国科学院 机器人与智能制造创新研究院, 辽宁 沈阳 110169
  • 收稿日期:2022-06-13 出版日期:2023-01-31 发布日期:2023-02-03
  • 通信作者: 许驰,副研究员,研究方向为工业无线网络、5G、人机交互。E-mail:xuchi@sia.cn E-mail:xuchi@sia.cn
  • 基金资助:
    国家自然科学基金（No.62173322，No.92267108）；中国科学院青年创新促进会基金（No.2019202）；辽宁省自然科学基金（No.2019-ZD-0069）资助

Force Haptic-Enhanced Virtual Reality Factory System

XU Wenbiao1,2,3,4, XU Chi2,3,4, SHI Hongyan1, LI Lin3,4   

  1. 1. College of Information Engineering, Shenyang University of Chemical Technology, Shenyang 110142, Liaoning, China;
    2. Key Laboratory of Networked Control Systems, Chinese Academy of Sciences, Shenyang 110016, Liaoning, China;
    3. Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang 110016, Liaoning, China;
    4. Institutes for Robotics and Intelligent Manufacturing, Chinese Academy of Sciences, Shenyang 110169, Liaoning, China
  • Received:2022-06-13 Online:2023-01-31 Published:2023-02-03

PDF

69

摘要： 现有虚拟现实工厂只能依靠头戴式显示器和手柄进行单向的视、听觉虚拟操作，难以进行双向的沉浸式触觉交互。针对此问题，采用力反馈控制器设计了一种力触觉增强的虚拟现实工厂系统。以Unity3D为基础，采用3DMax对工厂内多类型工具和零部件进行三维视觉建模，并通过反射探针、光照探针等组件进行立体化视觉增强。在此基础上，为虚拟空间物体增加刚体、碰撞体、关节等组件，建立虚拟空间的触觉反馈模型，实现了力反馈控制器与虚拟空间物体的实时触觉交互。实验表明：系统可提供重力、摩擦力、恒力等多种力触觉感知，支持对20余种工具、零部件的触摸、抓取等触感操作，能感受模型、轮廓以及质量等物理属性，实现了虚拟工厂中“视触听”多维立体化的沉浸式操作。

关键词: 虚拟现实, 触觉感知, 力反馈控制器, 虚拟工厂, 三维视觉

Abstract: Existing virtual reality factories that depend on helmets and handles can only provide one-way visual and auditory sensing for virtual operation, and cannot support immersive two-way tactile interaction. To deal with the problem, a haptics-enhanced virtual reality factory system is developed using force feedback controller. With Unity3D, 3DMax is used to model multiple kinds of tools and parts with 3D vision in the factory, and enhances their stereo vision by components such as reflection probes and light probes. Furthermore, by integrating components such as rigid bodies, collision bodies, joints to the virtual model, a tactile feedback model for the virtual space is established, which supports the real-time interaction between the haptic controller and virtual bodies. Experiments show that the system can provide a variety of force tactile perception capabilities such as mass, friction, and constant force. It supports tactile operations by touching and grasping more than 20 tools and parts, where the model, contour, and other physical attributes such as mass are provided. In this way, the system realizes the immersive operation experience of multi-dimensional audio-visual-haptic operation in the virtual factory.

Key words: virtual reality, tactile sensing, force feedback controller, virtual factory, 3D vision

中图分类号: