Skip to main navigation menu Skip to main content Skip to site footer

Evaluation of User Interfaces Description Languages to Augmented Reality

Abstract

Augmented reality is a rapidly advancing technology as it is widely used in several applications and domains, from the aerospace industry to medical-surgical applications, particularly in learning and training. A fundamental part of the educational use is the graphical user interface as a vehicle to deliver information to students. Within the augmented experiences development process, it is necessary to identify the most appropriate way to describe the user interface. This article evaluates languages describing augmented reality user interfaces. In this paper, several languages are analyzed, and new criteria are proposed to extend the evaluation framework. Finally, the results show the current limitations and the slowdown of development and adaptation of new languages for augmented reality platforms.

Keywords

Augmented Reality, Description Languages, model-based user interfaces design, user interfaces

XML PDF

Author Biography

Camilo-Andrés Cruz-Carrizales

Roles: Investigation, Writing – original draft.

Luis-Eduardo Bautista-Rojas

Roles: Methodology, Validation, Writing – review & editing.

Gabriel-Rodrigo Pedraza-Ferreira

Roles: Validation, Writing – review & editing.


References

  1. W. Li, A. Y. C. Nee, S. K. Ong, “A state-of-the-art review of augmented reality in engineering analysis and simulation,” Multimodal Technologies and Interaction, vol. 1, no. 3, e17, 2017. https://doi.org/10.3390/mti1030017 DOI: https://doi.org/10.3390/mti1030017
  2. S. C.-Y. Yuen, G. Yaoyuneyong, E. Johnson, “Augmented Reality: An Overview and Five Directions for AR in Education,” Journal of Educational Technology Development and Exchange, vol. 4, no. 1, e11, 2011. https://doi.org/10.18785/jetde.0401.10 DOI: https://doi.org/10.18785/jetde.0401.10
  3. A. O. Alkhamisi, M. M. Monowar, “Rise of Augmented Reality: Current and Future Application Areas,” International Journal of Internet and Distributed System, vol. 1, no. 4, pp. 25–34, 2013. https://doi.org/10.4236/ijids.2013.14005 DOI: https://doi.org/10.4236/ijids.2013.14005
  4. A. Vitzhum, “Towards a structured design of Augmented Reality Applications,” in IEEE VR 2006 Work. “Specification Mix. Real. User Interfaces”, pp. 16–19, 2006,
  5. A. Oliveira, R. B. Araujo, “Creation and visualization of context aware augmented reality interfaces,” in AVI '12: Proceedings of the International Working Conference on Advanced Visual Interfaces, 2021, pp. 324–327. https://doi.org/10.1145/2254556.2254618 DOI: https://doi.org/10.1145/2254556.2254618
  6. C. Kulas, C. Sandor, G. Klinker, “Towards a Development Methodology for Augmented Reality User Interfaces,” in MIXER '04, Exploring the Design and Engineering of Mixed Reality Systems, 2004. http://ceur-ws.org/Vol-91/paperD4.pdf
  7. A. Visser, “Survey of XML Languages for Augmented Reality Content,” in Proceedings Augmented Reality Standard Forum, 2010, pp. 1–7.
  8. A. V. Córdova Gonzales, “Un navegador de realidad aumentada para aplicaciones basadas en marcadores aplicando el estándar ARML 2.0,” Grade Thesis, Universidad Nacional Mayor de San Marcos, Lima, Perú, 2017.
  9. B. Kitchenham, S. Charters, Guidelines for performing Systematic Literature Reviews in Software Engineering, 2007. https://www.elsevier.com/__data/promis_misc/525444systematicreviewsguide.pdf.
  10. H. Ramirez, E. G. Mendivil, P. R. Flores, M. C. Gonzalez, “Authoring software for augmented reality applications for the use of maintenance and training process,” Procedia Computer Science, vol. 25, pp. 189–193, 2013. https://doi.org/10.1016/j.procs.2013.11.023 DOI: https://doi.org/10.1016/j.procs.2013.11.023
  11. M. Lechner, “OGC Augmented Reality Markup Language 2.0 (ARML 2.0), Version 1.0,” Open Geospatial Consortium, Wayland, 2015. https://doi.org/10.25607/OBP-600
  12. F. Ledermann, “An authoring framework for augmented reality presentations,” Master Thesis, University of Technology, Vienna, Austria, 2004.
  13. D. Rumiński, K. Walczak, “CARL: A Language for Modelling Contextual Augmented Reality Environments,” IFIP Advances in Information and Communication Technology, vol. 423, no. April 2014, pp. 183–190, 2014. https://doi.org/10.1007/978-3-642-54734-8_21 DOI: https://doi.org/10.1007/978-3-642-54734-8_21
  14. R. Wojciechowski, “Modeling Interactive Augmented Reality Environments,” in Interactive 3D Multimedia Content: Models for Creation, Management, Search and Presentation, Eds. W. Cellary and K. Walczak. London: Springer London, 2012, pp. 137–170. DOI: https://doi.org/10.1007/978-1-4471-2497-9_6
  15. A. Vitzthum, “SSIML/AR: A Visual Language for the Abstract Specification of Augmented Reality User Interfaces,” in 3D User Interfaces (3DUI’06), 2006, pp. 135–142. https://doi.org/10.1109/VR.2006.123
  16. B. MacIntyre, A. Hill, H. Rouzati, M. Gandy, B. Davidson, “The Argon AR Web Browser and standards-based AR application environment,” in 10th IEEE International Symposium on Mixed and Augmented Reality, 2011, pp. 65–74. https://doi.org/10.1109/ISMAR.2011.6092371 DOI: https://doi.org/10.1109/ISMAR.2011.6092371
  17. P. Figueroa, R. Dachselt, I. Lindt, “A Conceptual Model and Specification Language for Mixed Reality Interface Components,” in IEEE 2006 Virtual Reality Workshop, 2006, pp. 1–4.
  18. M. S. Gonzalez, C. L. Gómez, ARUIML: A Three-dimensional User Interface Description Language for Augmented Reality, 2013.
  19. W. Broll, I. Lindt, J. Ohlenburg, A. Linder, A Framework for Realizing Multi-Modal VR and AR User Interfaces, 2005.
  20. C. Sandor, T. Reicher, “CUIML: A language for generating multimodal human-computer interfaces,” in Proceedings of the European UIML Conference, 2001.
  21. Google, KML Reference-Keyhole Markup Language-Google Developers, 2020. https://developers.google.com/kml/documentation/kmlreference
  22. B. MacIntyre, H. Rouzati, M. Lechner, “Walled gardens: apps and data as barriers to augmenting reality,” IEEE Computer Graphics and Applications, vol. 33, no. 3, pp. 77-81, 2013. https://doi.org/10.1109/mcg.2013.51 DOI: https://doi.org/10.1109/MCG.2013.51
  23. C. Portele, “OpenGIS® Geography Markup Language (GML) Encoding Standard, Version 3.2.2,” Open Geospatial Consortium, Wayland, 2016. https://doi.org/10.25607/OBP-660
  24. R. Arnaud, M. Barnes, COLLADA: Sailing the gulf of 3D digital content creation, 2006. DOI: https://doi.org/10.1201/b10630
  25. Arf, GR ARF 001 - V1.1.1 - Augmented Reality Framework (ARF); AR standards landscape, 2019. https://portal.etsi.org/TB/ETSIDeliverableStatus.aspx
  26. D. Schmalstieg A. Fuhrmann, G. Hesina, Z. Szalavári, L. M. Encarnação, M. Gervautz, W. Purgathofer, “The Studierstube Augmented Reality Project,” Presence: Teleoperators and Virtual Environments, vol. 11, no. 1, pp. 33–54, 2002. https://doi.org/10.1162/105474602317343640 DOI: https://doi.org/10.1162/105474602317343640
  27. F. Ledermann, D. Schmalstieg, “APRIL: A high-level framework for creating augmented reality presentations,” in IEEE Proceedings. VR, 2005, pp. 187–194. https://doi.org/10.1109/vr.2005.1492773 DOI: https://doi.org/10.1109/VR.2005.1492773
  28. A. Vitzthum, H. Hussmann, “Modeling augmented reality user interfaces with SSIML/AR,” Journal of Multimedia, vol. 1, no. 3, pp. 13–22, 2006. https://doi.org/10.4304/jmm.1.3.13-22 DOI: https://doi.org/10.4304/jmm.1.3.13-22
  29. K. Walczak, D. Rumiński, J. Flotyński, “Building Contextual Augmented Reality Environments with semantics,” in International Conference on Virtual Systems & Multimedia (VSMM), 2014, pp. 353–361. https://doi.org/10.1109/VSMM.2014.7136656 DOI: https://doi.org/10.1109/VSMM.2014.7136656
  30. D. Ruminski, K. Walczak, “Dynamic composition of interactive AR scenes with the CARL language,” in 5th International Conference on Information, Intelligence, Systems and Applications, 2014, pp. 329–334. https://doi.org/10.1109/IISA.2014.6878808 DOI: https://doi.org/10.1109/IISA.2014.6878808
  31. D. Ruminski, “Modeling spatial sound in contextual augmented reality environments,” in 6th International Conference on Information, Intelligence, Systems and Applications (IISA), 2015, pp. 1–6. https://doi.org/10.1109/IISA.2015.7387982 DOI: https://doi.org/10.1109/IISA.2015.7387982
  32. K. Walczak, R. Wojciechowski, “Dynamic Creation of Interactive Mixed Reality Presentations,” in Proceedings of the ACM Symposium on Virtual Reality Software and Technology, 2005, pp. 167–176. https://doi.org/10.1145/1101616.1101653 DOI: https://doi.org/10.1145/1101616.1101653
  33. A. Vitzthum, A. Pleuss, “SSIML: Designing Structure and Application Integration of 3D Scenes,” in Proceedings of the Tenth International Conference on 3D Web Technology, 2005, pp. 9–17. https://doi.org/10.1145/1050491.1050493 DOI: https://doi.org/10.1145/1050491.1050493
  34. A. Hill, B. MacIntyre, M. Gandy, B. Davidson, H. Rouzati, “KHARMA: An open KML/HTML architecture for mobile augmented reality applications,” in IEEE International Symposium on Mixed and Augmented Reality, 2010, pp. 233–234. https://doi.org/10.1109/ISMAR.2010.5643583 DOI: https://doi.org/10.1109/ISMAR.2010.5643583
  35. M. Lechner, “ARML 2.0 in the context of existing AR data formats,” in 6th Workshop on Software Engineering and Architectures for Realtime Interactive Systems (SEARIS), 2013, pp. 41–47. https://doi.org/10.1109/SEARIS.2013.6798107 DOI: https://doi.org/10.1109/SEARIS.2013.6798107
  36. P. Figueroa, M. Green, H. J. Hoover, “InTml: A Description Language for VR Applications,” in Proceedings of the Seventh International Conference on 3D Web Technology, 2002, pp. 53–58. https://doi.org/10.1145/504502.504511 DOI: https://doi.org/10.1145/504502.504511
  37. S. Ahn, H. Ko, B. Yoo, “Webizing mobile augmented reality content,” New Review of Hypermedia and Multimedia, vol. 20, no. 1, pp. 79–100, 2014. https://doi.org/10.1080/13614568.2013.857727 DOI: https://doi.org/10.1080/13614568.2013.857727
  38. A. Vitzthum, “SSIML/behaviour: Designing behaviour and animation of graphical objects in virtual reality and multimedia applications,” in Seventh IEEE International Symposium on Multimedia (ISM'05), 2005, pp. 159–167. https://doi.org/10.1109/ISM.2005.109 DOI: https://doi.org/10.1109/ISM.2005.109
  39. T. Liao, “Standards and Their (Recurring) Stories: How Augmented Reality Markup Language Was Built on Stories of Past Standards,” Science, Technology, & Humam Values, vol. 45, no. 4, pp. 712–737, 2020. https://doi.org/10.1177/0162243919867417 DOI: https://doi.org/10.1177/0162243919867417

Downloads

Download data is not yet available.

Similar Articles

You may also start an advanced similarity search for this article.