Existing virtual reality factories that depend on helmets and handles can only provide one-way visual and auditory sensing for virtual operation, and cannot support immersive two-way tactile interaction. To deal with the problem, a haptics-enhanced virtual reality factory system is developed using force feedback controller. With Unity3D, 3DMax is used to model multiple kinds of tools and parts with 3D vision in the factory, and enhances their stereo vision by components such as reflection probes and light probes. Furthermore, by integrating components such as rigid bodies, collision bodies, joints to the virtual model, a tactile feedback model for the virtual space is established, which supports the real-time interaction between the haptic controller and virtual bodies. Experiments show that the system can provide a variety of force tactile perception capabilities such as mass, friction, and constant force. It supports tactile operations by touching and grasping more than 20 tools and parts, where the model, contour, and other physical attributes such as mass are provided. In this way, the system realizes the immersive operation experience of multi-dimensional audio-visual-haptic operation in the virtual factory.
XU Wenbiao, XU Chi, SHI Hongyan, LI Lin
. Force Haptic-Enhanced Virtual Reality Factory System[J]. Journal of Applied Sciences, 2023
, 41(1)
: 71
-79
.
DOI: 10.3969/j.issn.0255-8297.2023.01.006
[1] 莫瑞超, 许小龙, 何强, 等. 面向车联网边缘计算的智能计算迁移研究[J]. 应用科学学报, 2020, 38(5):779-791. Mo R C, Xu X L, He Q, et al. Intelligent computing offloading for Internet of vehicles in edge computing[J]. Journal of Applied Sciences, 2020, 38(5):779-791. (in Chinese)
[2] Yildiz E, Mller C, Bilberg A. Virtual factory:digital twin based integrated factory simulations[J]. Procedia CIRP, 2020, 93:216-221.
[3] Kesavadas T, Ernzer M. Design of an interactive virtual factory using cell formation methodologies[J]. Journal of Advanced Manufacturing Systems, 2003, 2(2):229-246.
[4] Sekaran S C, Yap H J, Musa S N, et al. The implementation of virtual reality in digital factory-a comprehensive review[J]. International Journal of Advanced Manufacturing Technology, 2021, 115(5):1349-1366.
[5] Gong L, Sderlund H, Bogojevic L, et al. Interaction design for multi-user virtual reality systems:an automotive case study[J]. Procedia CIRP, 2020, 93:1259-1264.
[6] 杨壹斌, 李敏, 解鸿文. 基于Unity3D的桌面式虚拟维修训练系统[J]. 计算机应用, 2016, 36(增刊2):125-128. Yang Y B, Li M, Xie H W. Desktop virtual maintenance training system based on Unity3D[J]. Journal of Computer Applications, 2016, 36(Suppl.2):125-128. (in Chinese)
[7] 闫文珠, 刘成, 李磊民, 等. 基于VR技术的机器人核事故训练平台研究[J]. 计算机仿真, 2015, 32(9):395-399. Yan W Z, Liu C, Li L M, et al. Research on training platform of robot in nuclear accident based on VR technology[J]. Computer Simulation, 2015, 32(9):395-399. (in Chinese)
[8] 李超鹏. 论虚拟现实技术在现代工业设计中的应用[D]. 济南:齐鲁工业大学, 2020.
[9] 戴大蒙. 交互式虚拟环境下的工厂规划与车间布局[J]. 中国机械工程, 2011, 22(10):1180-1184. Dai D M. Factory planning and workshop layout based on interactive virtual environment[J]. China Mechanical Engineering, 2011, 22(10):1180-1184. (in Chinese)
[10] 郭园, 童倩倩, 郑宇铠, 等. 融合多元触觉和沉浸式视觉的可移植VR软件框架[J]. 系统仿真学报, 2020, 32(7):1385-1392. Guo Y, Tong Q Q, Zheng Y K, et al. An adaptable VR software framework for collaborative multi-modal haptic and immersive visual display[J]. Journal of System Simulation, 2020, 32(7):1385-1392. (in Chinese)
[11] 魏青, 刘钊铭, 刘乃龙, 等. 沉浸式虚拟现实系统中头部位姿预测方法[J]. 信息与控制, 2019, 48(1):50-56, 64. Wei Q, Liu Z M, Liu N L, et al. Head pose prediction method for immersive virtual reality system[J]. Information and Control, 2019, 48(1):50-56, 64. (in Chinese)
[12] 王党校, 焦健, 张玉茹, 等. 计算机触觉:虚拟现实环境的力触觉建模和生成[J]. 计算机辅助设计与图形学学报, 2016, 28(6):881-895. Wang D X, Jiao J, Zhang Y R, et al. Computer haptics:haptic modeling and rendering in virtual reality environments[J]. Journal of Computer-Aided Design & Computer Graphics, 2016, 28(6):881-895. (in Chinese)
[13] 宋爱国, 田磊, 倪得晶, 等. 多模态力触觉交互技术及应用[J]. 中国科学(信息科学), 2017, 47(9):1183-1197. Song A G, Tian L, Ni D J, et al. Multi-mode haptic interaction technique and its application[J]. Scientia Sinica (Informationis), 2017, 47(9):1183-1197. (in Chinese)
[14] 王景港, 夏光明, 代煜, 等. 基于振动触觉反馈的机器人辅助骨曲面铣削[J]. 机器人, 2021, 43(4):484-492. Wang J G, Xia G M, Dai Y, et al. Robot-assisted milling on the bone curved surface based on vibrotactile feedback[J]. Robot, 2021, 43(4):484-492. (in Chinese)
