1. Proceedings
  2. I3M
  3. 2020
  4. EMSS
  5. 10.46354/i3m.2020.emss.060

Extended Reality technologies for industrial innovation

  • a Agostino G. Bruzzone ,
  • b Kirill Sinelshchikov,
  • c Marina Massei,
  • d Giuliano Fabbrini,
  • e Marco Gotelli
  • a,c Simulation Team, SIM4Future, via Trento 34, 16145 Genova, Italy
  • b,d,e Simulation Team, DIME, University of Genova, via Opera Pia 15, 16145 Genova, Italy
Cite as
(a)Agostino G. Bruzzone, (b)Kirill Sinelshchikov, (c)Marina Massei, (d)Giuliano Fabbrini, (e)Marco Gotelli (2020). Extended Reality technologies for industrial innovation. Proceedings of the 32nd European Modeling & Simulation Symposium (EMSS 2020), pp. 435-443. DOI: https://doi.org/10.46354/i3m.2020.emss.062

Abstract

This paper presents an overview on immersive technologies in relation to their potential for industrial innovation. In particular, Extended Reality (XR) is proposed by describing the most common solutions and innovative methods to overcome inherent problems of these technologies. Virtual & Augmented Reality (VR & AR ) are presented respect their potential for uses such as innovative human-machine interfaces, remote maintenance, remote commissioning, 3D rendering, virtual factory, virtual assembly and training. The paper analyze the strong contribution that Immersive Technologies are bringing in multiple sectors including Industries and the future trends aiming to further increase usability of these technologies such as it is happening in overcoming spatial constraints.

References

  1. Advani, S., & Va, M. (1995). The design of a high-performance all-composite flight simulator motion platform. In Flight Simulation Technologies Conference (p. 3382).
  2. Amico, V., Bruzzone, A. G., & Guha, R. (2000, July). Critical issues in simulation. In SUMMER COMPUTER SIMULATION CONFERENCE (pp. 893-898). Society for Computer Simulation International; 1998.
  3. Angelino, C. V., Baraniello, V. R., & Cicala, L. (2012, July). UAV position and attitude estimation using IMU, GNSS and camera. In 2012 15th International Conference on Information Fusion (pp. 735-742). IEEE.
  4. Benford, S., & Giannachi, G. (2011). Performing mixed reality. The MIT Press
  5. Berg, L. P., & Vance, J. M. (2017). Industry use of virtual reality in product design and manufacturing: a survey. Virtual reality, 21(1), 1-17.
  6. Bowman, D. A., McMahan, R. P., & Ragan, E. D. (2012). Questioning naturalism in 3D user interfaces. Communications of the ACM, 55(9), 78-88.
  7. Brunner Elektronik AG, Factsheet 6DOF Motion 1000, Industriestrasse 27,CH - 8335 Hittnau
  8. Bruzzone, A. G., & Giribone, P. (1998, April). Decision-support systems and simulation for logistics: Moving forward for a distributed, real-time, interactive simulation environment. In Proceedings 31st Annual Simulation Symposium (pp. 17-24). IEEE.
  9. Bruzzone, A. G., & Longo, F. (2013). 3D simulation as training tool in container terminals: The TRAINPORTS simulator. Journal of Manufacturing Systems, 32(1), 85-98.
  10. Bruzzone, A. G., & Massei, M. (2017). Simulation-based military training. In Guide to Simulation-Based Disciplines (pp. 315-361). Springer, Cham.
  11. Bruzzone, A. G., Fancello, G., Daga, M., Leban, B., & Massei, M. (2019). Mixed reality for industrial applications: interactions in human-machine system and modelling in immersive virtual environment. International Journal of Simulation and Process Modelling, 14(2), 165-177.
  12. Bruzzone, A. G., Longo F., Nicoletti L., Vetrano M., Bruno L., Chiurco A., Fusto C., Vignali G. (2016d). Augmented reality and mobile technologies for maintenance, security and operations in industrial facilities. 28th European Modeling and Simulation Symposium, EMSS 2016, pp. 355
  13. Bruzzone, A. G., Longo, F., Agresta, M., Di Matteo, R., & Maglione, G. L. (2016b). Autonomous systems for operations in critical environments. In Proceedings of the Modeling and Simulation of Complexity in Intelligent, Adaptive and Autonomous Systems 2016 (MSCIAAS 2016) and Space Simulation for Planetary Space Exploration (SPACE 2016) (pp. 1-8).
  14. Bruzzone, A. G., Massei, M., Maglione, G. L., Agresta, M., Franzinetti, G., & Padovano, A. (2016a). Virtual and augmented reality as enablers for improving the service on distributed assets. Proc. of I3M, Larnaca, Cyprus, September.
  15. Bruzzone, A. G., Massei, M., Maglione, G. L., Di Matteo, R., & Franzinetti, G. (2016c). Simulation of manned & autonomous systems for critical infrastructure protection. Proceedings of DHSS, Larnaca, Cypurs, September.
  16. Cameron, C. R., DiValentin, L. W., Manaktala, R., McElhaney, A. C., Nostrand, C. H., Quinlan, O. J., ... & Gerling, G. J. (2011, April). Hand tracking and visualization in a virtual reality simulation. In 2011 IEEE systems and information engineering design symposium (pp. 127-132). IEEE.
  17. Chang, C. C., & Tsai, W. H. (2001). Vision-based tracking and interpretation of human leg movement for virtual reality applications. IEEE transactions on circuits and systems for video technology, 11(1), 9-24.
  18. Chen, J., Fang, Y. C., Loftin, R. B., Leiss, E. L., Lin, C. Y., & Su, S. (2001). An immersive virtual environment training system on real-time motion platform. Proc. of the Computer Aided Design and Computer Graphics, 2, 951-954.
  19. Coelho, J. C., & Verbeek, F. J. (2014). Pointing task evaluation of leap motion controller in 3D virtual environment. Creating the difference, 78, 78-85.
  20. Cortes, G., Marchand, E., Ardouinz, J., & Lécuyer, A. (2017, March). Increasing optical tracking workspace of VR applications using controlled cameras. In 2017 IEEE Symposium on 3D User Interfaces (3DUI) (pp. 22-25). IEEE.
  21. Cruz-Neira, C., Sandin, D. J., & DeFanti, T. A. (1993, September). Surround-screen projection-based virtual reality: the design and implementation of the CAVE. In Proceedings of the 20th annual conference on Computer graphics and interactive techniques (pp. 135-142).
  22. Cruz-Neira, C., Sandin, D.J., DeFanti, T.A., Kenyon, R.V., Hart, J.C. (1992) "The CAVE: audio visual experience automatic virtual environment", ACM Commun., 35 (6), 64–72.
  23. Elor, A., Powell, M., Mahmoodi, E., Hawthorne, N., Teodorescu, M., & Kurniawan, S. (2020). On shooting stars: Comparing cave and hmd immersive virtual reality exergaming for adults with mixed ability. ACM Transactions on Computing for Healthcare, 1(4), 1-22.
  24. Foxlin, E., Harrington, M., & Pfeifer, G. (1998, July). Constellation: a wide-range wireless motion-tracking system for augmented reality and virtual set applications. In Proceedings of the 25th annual conference on Computer graphics and interactive techniques (pp. 371-378).
  25. Fujimoto, R. M. (2000). Parallel and distributed simulation systems (Vol. 300). New York: Wiley.
  26. Gomez-Barquero, D., Li, W., Fuentes, M., Xiong, J., Araniti, G., Akamine, C., & Wang, J. (2019). IEEE Transactions on Broadcasting special issue on: 5G for broadband multimedia systems and broadcasting. IEEE Transactions on Broadcasting, 65(2), 351-355.
  27. Gonzalez, D. S., Moro, A. D., Quintero, C., & Sarmiento, W. J. (2016, August). Fear levels in virtual environments, an approach to detection and experimental user stimuli sensation”, Proc. of XXI IEEE Symposium on Signal Processing, Images and Artificial Vision (STSIVA), pp. 1-6
  28. Graf, M., Timmerer, C., & Mueller, C. (2017, June). Towards bandwidth efficient adaptive streaming of omnidirectional video over http: Design, implementation, and evaluation. In Proceedings of the 8th ACM on Multimedia Systems Conference (pp. 261-271).
  29. Hale, K. S., & Stanney, K. M. (2014). "Handbook of virtual environments", CRC Press, Boca Raton, FL
  30. Hell, S., & Argyriou, V. (2018, December). Machine learning architectures to predict motion sickness using a virtual reality rollercoaster simulation tool. In 2018 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR) (pp. 153-156). IEEE.
  31. Hereld, M., Judson, I. R., & Stevens, R. L. (2000). "Introduction to building projection-based tiled display systems". IEEE Computer Graphics and Applications, 20. pp. 22-28
  32. Jacobson J.,Hwang Z.(2002) "Unreal tournament for immersive interactive theater", ACM Comm., 45 (1), 39–42
  33. Kenyon, A., Van Rosendale, J., Fulcomer, S., & Laidlaw, D. (2014). "The design of a retinal resolution fully immersive VR display", Virtual Reality (VR), IEEE, pp. 89-90
  34. Kim, S. J., Jeong, Y., Park, S., Ryu, K., & Oh, G. (2018). A survey of drone use for entertainment and AVR (augmented and virtual reality). In Augmented Reality and Virtual Reality (pp. 339-352). Springer, Cham.
  35. Ko, S. M., Chang, W. S., & Ji, Y. G. (2013). Usability principles for augmented reality applications in a smartphone environment. International journal of human-computer interaction, 29(8), 501-515.
  36. Kumari, S., & Polke, N. (2018, August). Implementation Issues of Augmented Reality and Virtual Reality: A Survey. In International Conference on Intelligent Data Communication Technologies and Internet of Things (pp. 853-861). Springer, Cham
  37. Lee, S. M., Xia, K., & Son, H. (2020). Robust Tracking Control of Spherical Motion Platform for Virtual Reality. IEEE Transactions on Industrial Electronics.
  38. Liu, E. Theodoropoulos G.(2014)"Space-time matching algorithms for interest management in distributed virtual environments”, ACM TOMACS, vol.24
  39. Liu, R., Wang, L., Lei, J., Wang, Q., & Ren, Y. (2020). Effects of an immersive virtual reality‐based classroom on students’ learning performance in science lessons. British Journal of Educational Technology, e13434.
  40. Longo, F., Nicoletti, L., & Padovano, A. (2018). An interactive, interoperable and ubiquitous mixed reality application for a smart learning experience. International Journal of Simulation and Process Modelling, 13(6), 589-603.
  41. Lu, Y., & Xu, X. (2018). Resource virtualization: a core technology for developing cyber-physical production systems. Journal of Manufacturing Systems, 47, 128-140.
  42. Mastli, M., & Zhang, J. (2017). Interactive highway construction simulation using game engine and virtual reality for education and training purpose. In Computing in Civil Engineering 2017 (pp. 399-406).
  43. Mi, L., Zhang, W., Chen, C. P., Zhou, Y., Li, Y., Yu, B., & Maitlo, N. (2018, May). A retinal-projection-based near-eye display for virtual reality. In Digital Optics for Immersive Displays (Vol. 10676, p. 106761C). International Society for Optics and Photonics.
  44. Mourtzis, D., Zogopoulos, V., & Vlachou, E. (2017). Augmented reality application to support remote maintenance as a service in the robotics industry. Procedia Cirp, 63(2017), 46-51.
  45. Muhanna, M. A. (2015) "Virtual reality and the CAVE: Taxonomy, interaction challenges and research directions", Journal of King Saud University-Computer and Information Sciences, 27(3), 344-361
  46. Muñoz-Saavedra, L., Miró-Amarante, L., & Domínguez-Morales, M. (2020). Augmented and Virtual Reality Evolution and Future Tendency. Applied Sciences, 10(1), 322.
  47. Oberhauser, M., Dreyer, D., Mamessier, S., Convard, T., Bandow, D., & Hillebrand, A. (2015, August). Bridging the gap between desktop research and full flight simulators for human factors research. In International Conference on Engineering Psychology and Cognitive Ergonomics (pp. 460-471). Springer, Cham.
  48. Papachristos, N. M., Vrellis, I., & Mikropoulos, T. A. (2017, July). A comparison between oculus rift and a low-cost smartphone VR headset: immersive user experience and learning. In 2017 IEEE 17th International Conference on Advanced Learning Technologies (ICALT) (pp. 477-481). IEEE.
  49. Park, J., Chen, J., & Cho, Y. K. (2017). Self-corrective knowledge-based hybrid tracking system using BIM and multimodal sensors. Advanced Engineering Informatics, 32, 126-138.
  50. Pence, H. E. (2010). Smartphones, smart objects, and augmented reality. The Reference Librarian, 52(1-2), 136-145.
  51. Pollini, L., Innocenti, M., & Petrone, A. (2008). Novel motion platform for flight simulators using an anthropomorphic robot. Journal of Aerospace Computing, Information, and Communication, 5(7), 175-196.
  52. Puig, A., Rodríguez, I., Arcos, J. L., Rodríguez-Aguilar, J. A., Cebrián, S., Bogdanovych, A., ... & Piqué, R. (2020). Lessons learned from supplementing archaeological museum exhibitions with virtual reality. Virtual Reality, 24(2), 343-358.
  53. Qi, Q., & Tao, F. (2018). Digital twin and big data towards smart manufacturing and industry 4.0: 360 degree comparison. Ieee Access, 6, 3585-3593.
  54. Sagayam, K. M., & Hemanth, D. J. (2017). Hand posture and gesture recognition techniques for virtual reality applications: a survey. Virtual Reality, 21(2), 91-107.
  55. Schroeder, J. A. (1999). Helicopter flight simulation motion platform requirements, NASA Technical Report, Ames Research Center, Moffett Field, California
  56. Shin, J., An, G., Park, J. S., Baek, S. J., & Lee, K. (2016). Application of precise indoor position tracking to immersive virtual reality with translational movement support. Multimedia tools and applications, 75(20), 12331-12350.
  57. Steed, A., & Julier, S. (2013, March). Design and implementation of an immersive virtual reality system based on a smartphone platform. In 2013 IEEE Symposium on 3D User Interfaces (3DUI) (pp. 43-46). IEEE.
  58. Thöndel, E. (2010). Electric motion platform for use in simulation technology–design and optimal control of a linear electromechanical actuator. In Proceedings of the World Congress on Engineering and Computer Science (Vol. 2).
  59. VanderVliet, G. (1992). The Test, Evaluation, Development, and Use of a Manned Flight Simulator to Support Navy Developmental Testing of the V-22 Osprey (No. 921978). SAE Technical Paper.
  60. Wang, L. J., Hu, Q. N., & Shu, H. (2011). Research on Technologies of Machining Virtual Experiment. Donghua Daxue Xuebao(Ziran Ban), 37(4), 462-466.
  61. Wang, L., Groves, P. D., & Ziebart, M. K. (2012). Multi-constellation GNSS performance evaluation for urban canyons using large virtual reality city models. The Journal of Navigation, 65(3), 459-476.
  62. Whisker, V. E., Baratta, A. J., Yerrapathruni, S., Messner, J. I., Shaw, T. S., Warren, M. E., Rotthoff E.S., Winters J.W., Clelland J.A. & Johnson, F. T. (2003). "Using immersive virtual environments to develop and visualize construction schedules for advanced nuclear power plants". In Proceedings of ICAPP Vol. 3, pp. 4-7
  63. Zeigler, B. P., & Lee, J. S. (1998, August). Theory of quantized systems: formal basis for DEVS/HLA distributed simulation environment. In Enabling Technology for Simulation Science II (Vol. 3369, pp. 49-58). International Society for Optics and Photonics.
  64. Zhang, Y., Fei, Y., Xu, L., & Sun, G. (2015, July). Micro-IMU-based motion tracking system for virtual training. In 2015 34th Chinese Control Conference (CCC) (pp. 7753-7758). IEEE.