Evaluation of User Interfaces Description Languages to Augmented Reality
Abstract
Augmented reality is a rapidly advancing technology as it is widely used in several applications and domains, from the aerospace industry to medical-surgical applications, particularly in learning and training. A fundamental part of the educational use is the graphical user interface as a vehicle to deliver information to students. Within the augmented experiences development process, it is necessary to identify the most appropriate way to describe the user interface. This article evaluates languages describing augmented reality user interfaces. In this paper, several languages are analyzed, and new criteria are proposed to extend the evaluation framework. Finally, the results show the current limitations and the slowdown of development and adaptation of new languages for augmented reality platforms.
Keywords
Augmented Reality, Description Languages, model-based user interfaces design, user interfaces
Author Biography
Camilo-Andrés Cruz-Carrizales
Roles: Investigation, Writing – original draft.
Luis-Eduardo Bautista-Rojas
Roles: Methodology, Validation, Writing – review & editing.
Gabriel-Rodrigo Pedraza-Ferreira
Roles: Validation, Writing – review & editing.
References
- W. Li, A. Y. C. Nee, S. K. Ong, “A state-of-the-art review of augmented reality in engineering analysis and simulation,” Multimodal Technologies and Interaction, vol. 1, no. 3, e17, 2017. https://doi.org/10.3390/mti1030017 DOI: https://doi.org/10.3390/mti1030017
- S. C.-Y. Yuen, G. Yaoyuneyong, E. Johnson, “Augmented Reality: An Overview and Five Directions for AR in Education,” Journal of Educational Technology Development and Exchange, vol. 4, no. 1, e11, 2011. https://doi.org/10.18785/jetde.0401.10 DOI: https://doi.org/10.18785/jetde.0401.10
- A. O. Alkhamisi, M. M. Monowar, “Rise of Augmented Reality: Current and Future Application Areas,” International Journal of Internet and Distributed System, vol. 1, no. 4, pp. 25–34, 2013. https://doi.org/10.4236/ijids.2013.14005 DOI: https://doi.org/10.4236/ijids.2013.14005
- A. Vitzhum, “Towards a structured design of Augmented Reality Applications,” in IEEE VR 2006 Work. “Specification Mix. Real. User Interfaces”, pp. 16–19, 2006,
- A. Oliveira, R. B. Araujo, “Creation and visualization of context aware augmented reality interfaces,” in AVI '12: Proceedings of the International Working Conference on Advanced Visual Interfaces, 2021, pp. 324–327. https://doi.org/10.1145/2254556.2254618 DOI: https://doi.org/10.1145/2254556.2254618
- C. Kulas, C. Sandor, G. Klinker, “Towards a Development Methodology for Augmented Reality User Interfaces,” in MIXER '04, Exploring the Design and Engineering of Mixed Reality Systems, 2004. http://ceur-ws.org/Vol-91/paperD4.pdf
- A. Visser, “Survey of XML Languages for Augmented Reality Content,” in Proceedings Augmented Reality Standard Forum, 2010, pp. 1–7.
- A. V. Córdova Gonzales, “Un navegador de realidad aumentada para aplicaciones basadas en marcadores aplicando el estándar ARML 2.0,” Grade Thesis, Universidad Nacional Mayor de San Marcos, Lima, Perú, 2017.
- B. Kitchenham, S. Charters, Guidelines for performing Systematic Literature Reviews in Software Engineering, 2007. https://www.elsevier.com/__data/promis_misc/525444systematicreviewsguide.pdf.
- H. Ramirez, E. G. Mendivil, P. R. Flores, M. C. Gonzalez, “Authoring software for augmented reality applications for the use of maintenance and training process,” Procedia Computer Science, vol. 25, pp. 189–193, 2013. https://doi.org/10.1016/j.procs.2013.11.023 DOI: https://doi.org/10.1016/j.procs.2013.11.023
- M. Lechner, “OGC Augmented Reality Markup Language 2.0 (ARML 2.0), Version 1.0,” Open Geospatial Consortium, Wayland, 2015. https://doi.org/10.25607/OBP-600
- F. Ledermann, “An authoring framework for augmented reality presentations,” Master Thesis, University of Technology, Vienna, Austria, 2004.
- D. Rumiński, K. Walczak, “CARL: A Language for Modelling Contextual Augmented Reality Environments,” IFIP Advances in Information and Communication Technology, vol. 423, no. April 2014, pp. 183–190, 2014. https://doi.org/10.1007/978-3-642-54734-8_21 DOI: https://doi.org/10.1007/978-3-642-54734-8_21
- R. Wojciechowski, “Modeling Interactive Augmented Reality Environments,” in Interactive 3D Multimedia Content: Models for Creation, Management, Search and Presentation, Eds. W. Cellary and K. Walczak. London: Springer London, 2012, pp. 137–170. DOI: https://doi.org/10.1007/978-1-4471-2497-9_6
- A. Vitzthum, “SSIML/AR: A Visual Language for the Abstract Specification of Augmented Reality User Interfaces,” in 3D User Interfaces (3DUI’06), 2006, pp. 135–142. https://doi.org/10.1109/VR.2006.123
- B. MacIntyre, A. Hill, H. Rouzati, M. Gandy, B. Davidson, “The Argon AR Web Browser and standards-based AR application environment,” in 10th IEEE International Symposium on Mixed and Augmented Reality, 2011, pp. 65–74. https://doi.org/10.1109/ISMAR.2011.6092371 DOI: https://doi.org/10.1109/ISMAR.2011.6092371
- P. Figueroa, R. Dachselt, I. Lindt, “A Conceptual Model and Specification Language for Mixed Reality Interface Components,” in IEEE 2006 Virtual Reality Workshop, 2006, pp. 1–4.
- M. S. Gonzalez, C. L. Gómez, ARUIML: A Three-dimensional User Interface Description Language for Augmented Reality, 2013.
- W. Broll, I. Lindt, J. Ohlenburg, A. Linder, A Framework for Realizing Multi-Modal VR and AR User Interfaces, 2005.
- C. Sandor, T. Reicher, “CUIML: A language for generating multimodal human-computer interfaces,” in Proceedings of the European UIML Conference, 2001.
- Google, KML Reference-Keyhole Markup Language-Google Developers, 2020. https://developers.google.com/kml/documentation/kmlreference
- B. MacIntyre, H. Rouzati, M. Lechner, “Walled gardens: apps and data as barriers to augmenting reality,” IEEE Computer Graphics and Applications, vol. 33, no. 3, pp. 77-81, 2013. https://doi.org/10.1109/mcg.2013.51 DOI: https://doi.org/10.1109/MCG.2013.51
- C. Portele, “OpenGIS® Geography Markup Language (GML) Encoding Standard, Version 3.2.2,” Open Geospatial Consortium, Wayland, 2016. https://doi.org/10.25607/OBP-660
- R. Arnaud, M. Barnes, COLLADA: Sailing the gulf of 3D digital content creation, 2006. DOI: https://doi.org/10.1201/b10630
- Arf, GR ARF 001 - V1.1.1 - Augmented Reality Framework (ARF); AR standards landscape, 2019. https://portal.etsi.org/TB/ETSIDeliverableStatus.aspx
- D. Schmalstieg A. Fuhrmann, G. Hesina, Z. Szalavári, L. M. Encarnação, M. Gervautz, W. Purgathofer, “The Studierstube Augmented Reality Project,” Presence: Teleoperators and Virtual Environments, vol. 11, no. 1, pp. 33–54, 2002. https://doi.org/10.1162/105474602317343640 DOI: https://doi.org/10.1162/105474602317343640
- F. Ledermann, D. Schmalstieg, “APRIL: A high-level framework for creating augmented reality presentations,” in IEEE Proceedings. VR, 2005, pp. 187–194. https://doi.org/10.1109/vr.2005.1492773 DOI: https://doi.org/10.1109/VR.2005.1492773
- A. Vitzthum, H. Hussmann, “Modeling augmented reality user interfaces with SSIML/AR,” Journal of Multimedia, vol. 1, no. 3, pp. 13–22, 2006. https://doi.org/10.4304/jmm.1.3.13-22 DOI: https://doi.org/10.4304/jmm.1.3.13-22
- K. Walczak, D. Rumiński, J. Flotyński, “Building Contextual Augmented Reality Environments with semantics,” in International Conference on Virtual Systems & Multimedia (VSMM), 2014, pp. 353–361. https://doi.org/10.1109/VSMM.2014.7136656 DOI: https://doi.org/10.1109/VSMM.2014.7136656
- D. Ruminski, K. Walczak, “Dynamic composition of interactive AR scenes with the CARL language,” in 5th International Conference on Information, Intelligence, Systems and Applications, 2014, pp. 329–334. https://doi.org/10.1109/IISA.2014.6878808 DOI: https://doi.org/10.1109/IISA.2014.6878808
- D. Ruminski, “Modeling spatial sound in contextual augmented reality environments,” in 6th International Conference on Information, Intelligence, Systems and Applications (IISA), 2015, pp. 1–6. https://doi.org/10.1109/IISA.2015.7387982 DOI: https://doi.org/10.1109/IISA.2015.7387982
- K. Walczak, R. Wojciechowski, “Dynamic Creation of Interactive Mixed Reality Presentations,” in Proceedings of the ACM Symposium on Virtual Reality Software and Technology, 2005, pp. 167–176. https://doi.org/10.1145/1101616.1101653 DOI: https://doi.org/10.1145/1101616.1101653
- A. Vitzthum, A. Pleuss, “SSIML: Designing Structure and Application Integration of 3D Scenes,” in Proceedings of the Tenth International Conference on 3D Web Technology, 2005, pp. 9–17. https://doi.org/10.1145/1050491.1050493 DOI: https://doi.org/10.1145/1050491.1050493
- A. Hill, B. MacIntyre, M. Gandy, B. Davidson, H. Rouzati, “KHARMA: An open KML/HTML architecture for mobile augmented reality applications,” in IEEE International Symposium on Mixed and Augmented Reality, 2010, pp. 233–234. https://doi.org/10.1109/ISMAR.2010.5643583 DOI: https://doi.org/10.1109/ISMAR.2010.5643583
- M. Lechner, “ARML 2.0 in the context of existing AR data formats,” in 6th Workshop on Software Engineering and Architectures for Realtime Interactive Systems (SEARIS), 2013, pp. 41–47. https://doi.org/10.1109/SEARIS.2013.6798107 DOI: https://doi.org/10.1109/SEARIS.2013.6798107
- P. Figueroa, M. Green, H. J. Hoover, “InTml: A Description Language for VR Applications,” in Proceedings of the Seventh International Conference on 3D Web Technology, 2002, pp. 53–58. https://doi.org/10.1145/504502.504511 DOI: https://doi.org/10.1145/504502.504511
- S. Ahn, H. Ko, B. Yoo, “Webizing mobile augmented reality content,” New Review of Hypermedia and Multimedia, vol. 20, no. 1, pp. 79–100, 2014. https://doi.org/10.1080/13614568.2013.857727 DOI: https://doi.org/10.1080/13614568.2013.857727
- A. Vitzthum, “SSIML/behaviour: Designing behaviour and animation of graphical objects in virtual reality and multimedia applications,” in Seventh IEEE International Symposium on Multimedia (ISM'05), 2005, pp. 159–167. https://doi.org/10.1109/ISM.2005.109 DOI: https://doi.org/10.1109/ISM.2005.109
- T. Liao, “Standards and Their (Recurring) Stories: How Augmented Reality Markup Language Was Built on Stories of Past Standards,” Science, Technology, & Humam Values, vol. 45, no. 4, pp. 712–737, 2020. https://doi.org/10.1177/0162243919867417 DOI: https://doi.org/10.1177/0162243919867417
Downloads
Download data is not yet available.