Discussing the application potentials of Microsoft HoloLens in production and logistics: a literature review and case study

  • Sebastian Lang  
  • bMohammed Saif Sheikh Dastagir Kota  
  • cDavid Weigert  
  • Fabian Behrendt  
  • abOtto von Guericke University Magdeburg
  • cFraunhofer Institute for Factory Operation and Automation IFF
  • SRH Mobile University
Cite as
S. Lang, M.S.S. Dastagir Kota, D. Weigert, F. Behrendt (2018). Discussing the application potentials of Microsoft HoloLensTM in production and logistics: a literature review and case study. Proceedings of the 4th International Conference of The Virtual And Augmented Reality In Education (VARE 2018), pp. 188-197. DOI: https://doi.org/10.46354/i3m.2018.vare.028

Abstract

The Microsoft HoloLens is an augmented reality (AR) head-mounted display (HMD) with the capability to enrich the user’s perceived environment with virtual information. The HoloLens is considered as state-of-theart device and provides some new features, which enhance the AR experience. The first part of this paper presents the current state of research concerning the application of Microsoft HoloLens in the field of production and logistics. In the second part, we present a small HoloLens application, which we have developed to evaluate the capabilities of the device. In addition, we asked several visitors of the Open House at our university to test our application and to give us feedback. An evaluation of the user experiences and future research challenges are provided at the end of the paper.

References

  1. Azuma R.T., 1997. A Survey of Augmented Reality. Teleoperators and Virtual Environments 6 (4), pp.355–388.
  2. Blankemeyer S., Wiemann R., Raatz A., 2018. Intuitive Assembly Support System Using Augmented Reality. In: Schüppstuhl T. Tracht K., Franke J., eds. Tagungsband des 3. Kongresses Montage Handhabung Industrieroboter. Berlin, DE: Springer, pp. 195–203.
  3. Blattgerste J., Strenge B., Renner P., Pfeiffer T., Essig K., 2017. Comparing Conventional and Augmented Reality Instructions for Manual Assembly Tasks. Proceedings of the 10th ACM International Conference on Pervasive Technologies Related to Assistive Environments, PETRA 2017, pp. 75–82. June 21–23, Island of Rhodes, GR.
  4. Canepa-Talamas D., Nassehi A., Dhokia V., 2017. Innovative Framework for Immersive Metrology. Procedia CIRP 60, pp. 110–115.
  5. Eschen H., Kötter T., Rodeck R., Harnisch M., Schüppstuhl T., 2018. Augmented and Virtual Reality for Inspection and Maintenance Processes in the Aviation Industry. Procedia Manufacturing 19, pp. 156–163.
  6. Guhl J., Tung S., Kruger J., 2017. Concept and Architecture for Programming Industrial Robots Using Augmented Reality with Mobile Devices like Microsoft HoloLens. Proceedings of the 22nd IEEE International Conference on Emerging Technologies and Factory Automation, ETFA  2017, pp. 1–4. September 12–15, Limassol, CY.
  7. Guhl J., Vick A., Vonasek V., Krüger J., 2018. Visualizing Trajectories for Industrial Robots from Sampling-Based Path Planning on Mobile Devices. In: Schüppstuhl T. Tracht K., Franke J., eds. Tagungsband des 3. Kongresses Montage Handhabung Industrieroboter. Berlin, DE: Springer, pp. 49–56.
  8. Gupta R.K., Belkadi F., Buergy C., Bitte F., Da Cunha C., Buergin J., Lanza G., Bernard A., 2018. Gathering, Evaluating and Managing Customer Feedback during Aircraft Production. Computers & Industrial Engineering 115, pp. 559–572.
  9. Hanson R., Falkenström W., Miettinen M., 2017. Augmented Reality as a Means of Conveying Picking Information in Kit Preparation for MixedModel Assembly. Computers & Industrial
    Engineering 113, pp. 570–575.
  10. Hofmann W., Langer S., Lang S., Reggelin T., 2017. Integrating Virtual Commissioning Based on High Level Emulation into Logistics Education. Procedia Engineering 178, pp. 24–32.
  11. Karlsson I., Bernedixen J., Ng A.H.C, Pehrsson L., 2017. Combining Augmented Reality and SimulationBased Optimization for Decision Support in Manufacturing. Proceedings of the 2017 Winter Simulation Conference, WSC 2017, pp. 3988– 3999. December 3–6, Las Vegas, NV, USA.
  12. Kot T., Novák P., Babjak J., 2017. Application of Augmented Reality in Mobile Robot Teleoperation. Modelling and Simulation for Autonomous Systems: 4th International Conference, MESAS 2017, pp. 223–236. October 24–26, Rome, IT.
  13. Kretschmer V. Plewan T., Rinkenauer G., Maettig B., 2018. Smart Palletisation: Cognitive Ergonomics in Augmented Reality Based Palletising. Proceedings of the 1st International Conference on Intelligent Human System Integration (IHSI 2018), pp. 355–360. January 7–9, Dubai, AE.
  14. Meta, 2018. Official Meta 2 Website. San Mateo, Meta Company. Available from: https://metaeu.myshopify.com/#specifications [accessed 15 May 2018].
  15. Microsoft, 2018. Official Microsoft HoloLens Website. Redmond, Microsoft Corporation. Available from: https://www.microsoft.com/hololens [accessed 15May 2018].
  16. Milgram P., Takemura H., Utsumi A., Kishino F., 1994. Augmented reality: A class of displays on the reality-virtuality continuum. Proceedings of SPIE: Telemanipulator and Telepresence Technologies 2351, pp. 282–292.
  17. Radkowski R., Ingebrand J., 2017. HoloLens for Assembly Assistance - A Focus Group Report. Virtual, Augmented and Mixed Reality: 9th International Conference, VAMR 2017, pp. 274– 282. July 9–14, Vancouver, BC, CA.
  18. Rückert P., Meiners F., Tracht K., 2018. Augmented Reality for Teaching Collaborative Robots Based on a Physical Simulation. In: Schüppstuhl T. Tracht K., Franke J., eds. Tagungsband des 3. Kongresses Montage Handhabung Industrieroboter. Berlin, DE: Springer, pp. 41–48.
  19. Taylor A.G., 2016. Develop Microsoft HoloLens Apps Now. 1st ed. New York: Springer.
  20. van der Meulen H., Kun A.L., Shaer O., 2017. What Are We Missing? Adding Eye-Tracking to the HoloLens to Improve Gaze Estimation Accuracy. Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces, ACM ISS 2017, pp. 396–400. October 17–20, 2017, Brighton, UK
  21. Werrlich S., Nitsche K., Notni G., 2017. Demand Analysis for an Augmented Reality based Assembly Training. Proceedings of the 10th ACM International Conference on Pervasive Technologies Related to Assistive Environments, PETRA 2017, pp. 416–422. June 21–23, Island of Rhodes, GR.