现有虚拟现实工厂只能依靠头戴式显示器和手柄进行单向的视、听觉虚拟操作，难以进行双向的沉浸式触觉交互。针对此问题，采用力反馈控制器设计了一种力触觉增强的虚拟现实工厂系统。以Unity3D为基础，采用3DMax对工厂内多类型工具和零部件进行三维视觉建模，并通过反射探针、光照探针等组件进行立体化视觉增强。在此基础上，为虚拟空间物体增加刚体、碰撞体、关节等组件，建立虚拟空间的触觉反馈模型，实现了力反馈控制器与虚拟空间物体的实时触觉交互。实验表明：系统可提供重力、摩擦力、恒力等多种力触觉感知，支持对20余种工具、零部件的触摸、抓取等触感操作，能感受模型、轮廓以及质量等物理属性，实现了虚拟工厂中“视触听”多维立体化的沉浸式操作。
Existing virtual reality factories that depend on helmets and handles can only provide one-way visual and auditory sensing for virtual operation, and cannot support immersive two-way tactile interaction. To deal with the problem, a haptics-enhanced virtual reality factory system is developed using force feedback controller. With Unity3D, 3DMax is used to model multiple kinds of tools and parts with 3D vision in the factory, and enhances their stereo vision by components such as reflection probes and light probes. Furthermore, by integrating components such as rigid bodies, collision bodies, joints to the virtual model, a tactile feedback model for the virtual space is established, which supports the real-time interaction between the haptic controller and virtual bodies. Experiments show that the system can provide a variety of force tactile perception capabilities such as mass, friction, and constant force. It supports tactile operations by touching and grasping more than 20 tools and parts, where the model, contour, and other physical attributes such as mass are provided. In this way, the system realizes the immersive operation experience of multi-dimensional audio-visual-haptic operation in the virtual factory.
[1] 莫瑞超, 许小龙, 何强, 等. 面向车联网边缘计算的智能计算迁移研究[J]. 应用科学学报, 2020, 38(5):779-791. Mo R C, Xu X L, He Q, et al. Intelligent computing offloading for Internet of vehicles in edge computing[J]. Journal of Applied Sciences, 2020, 38(5):779-791. (in Chinese)
[2] Yildiz E, Mller C, Bilberg A. Virtual factory:digital twin based integrated factory simulations[J]. Procedia CIRP, 2020, 93:216-221.
[3] Kesavadas T, Ernzer M. Design of an interactive virtual factory using cell formation methodologies[J]. Journal of Advanced Manufacturing Systems, 2003, 2(2):229-246.
[4] Sekaran S C, Yap H J, Musa S N, et al. The implementation of virtual reality in digital factory-a comprehensive review[J]. International Journal of Advanced Manufacturing Technology, 2021, 115(5):1349-1366.
[5] Gong L, Sderlund H, Bogojevic L, et al. Interaction design for multi-user virtual reality systems:an automotive case study[J]. Procedia CIRP, 2020, 93:1259-1264.
[6] 杨壹斌, 李敏, 解鸿文. 基于Unity3D的桌面式虚拟维修训练系统[J]. 计算机应用, 2016, 36(增刊2):125-128. Yang Y B, Li M, Xie H W. Desktop virtual maintenance training system based on Unity3D[J]. Journal of Computer Applications, 2016, 36(Suppl.2):125-128. (in Chinese)
[7] 闫文珠, 刘成, 李磊民, 等. 基于VR技术的机器人核事故训练平台研究[J]. 计算机仿真, 2015, 32(9):395-399. Yan W Z, Liu C, Li L M, et al. Research on training platform of robot in nuclear accident based on VR technology[J]. Computer Simulation, 2015, 32(9):395-399. (in Chinese)
[8] 李超鹏. 论虚拟现实技术在现代工业设计中的应用[D]. 济南:齐鲁工业大学, 2020.
[9] 戴大蒙. 交互式虚拟环境下的工厂规划与车间布局[J]. 中国机械工程, 2011, 22(10):1180-1184. Dai D M. Factory planning and workshop layout based on interactive virtual environment[J]. China Mechanical Engineering, 2011, 22(10):1180-1184. (in Chinese)
[10] 郭园, 童倩倩, 郑宇铠, 等. 融合多元触觉和沉浸式视觉的可移植VR软件框架[J]. 系统仿真学报, 2020, 32(7):1385-1392. Guo Y, Tong Q Q, Zheng Y K, et al. An adaptable VR software framework for collaborative multi-modal haptic and immersive visual display[J]. Journal of System Simulation, 2020, 32(7):1385-1392. (in Chinese)
[11] 魏青, 刘钊铭, 刘乃龙, 等. 沉浸式虚拟现实系统中头部位姿预测方法[J]. 信息与控制, 2019, 48(1):50-56, 64. Wei Q, Liu Z M, Liu N L, et al. Head pose prediction method for immersive virtual reality system[J]. Information and Control, 2019, 48(1):50-56, 64. (in Chinese)
[12] 王党校, 焦健, 张玉茹, 等. 计算机触觉:虚拟现实环境的力触觉建模和生成[J]. 计算机辅助设计与图形学学报, 2016, 28(6):881-895. Wang D X, Jiao J, Zhang Y R, et al. Computer haptics:haptic modeling and rendering in virtual reality environments[J]. Journal of Computer-Aided Design & Computer Graphics, 2016, 28(6):881-895. (in Chinese)
[13] 宋爱国, 田磊, 倪得晶, 等. 多模态力触觉交互技术及应用[J]. 中国科学(信息科学), 2017, 47(9):1183-1197. Song A G, Tian L, Ni D J, et al. Multi-mode haptic interaction technique and its application[J]. Scientia Sinica (Informationis), 2017, 47(9):1183-1197. (in Chinese)
[14] 王景港, 夏光明, 代煜, 等. 基于振动触觉反馈的机器人辅助骨曲面铣削[J]. 机器人, 2021, 43(4):484-492. Wang J G, Xia G M, Dai Y, et al. Robot-assisted milling on the bone curved surface based on vibrotactile feedback[J]. Robot, 2021, 43(4):484-492. (in Chinese)
