Evaluation of User Interfaces Description Languages to Augmented Reality

Evaluación de lenguajes de descripción de interfaces de usuario en realidad aumentada

Main Article Content

Camilo-Andrés Cruz-Carrizales
Luis-Eduardo Bautista-Rojas
Gabriel-Rodrigo Pedraza-Ferreira


Augmented reality is a rapidly advancing technology as it is widely used in several applications and domains, from the aerospace industry to medical-surgical applications, particularly in learning and training. A fundamental part of the educational use is the graphical user interface as a vehicle to deliver information to students. Within the augmented experiences development process, it is necessary to identify the most appropriate way to describe the user interface. This article evaluates languages describing augmented reality user interfaces. In this paper, several languages are analyzed, and new criteria are proposed to extend the evaluation framework. Finally, the results show the current limitations and the slowdown of development and adaptation of new languages for augmented reality platforms.



Download data is not yet available.

Article Details

Author Biographies (SEE)

Camilo-Andrés Cruz-Carrizales, Universidad Industrial de Santander

Roles: Investigation, Writing – original draft.

Luis-Eduardo Bautista-Rojas, Universidad Industrial de Santander

Roles: Methodology, Validation, Writing – review & editing.

Gabriel-Rodrigo Pedraza-Ferreira, Universidad Industrial de Santander

Roles: Validation, Writing – review & editing.

References (SEE)

W. Li, A. Y. C. Nee, S. K. Ong, “A state-of-the-art review of augmented reality in engineering analysis and simulation,” Multimodal Technologies and Interaction, vol. 1, no. 3, e17, 2017. https://doi.org/10.3390/mti1030017

S. C.-Y. Yuen, G. Yaoyuneyong, E. Johnson, “Augmented Reality: An Overview and Five Directions for AR in Education,” Journal of Educational Technology Development and Exchange, vol. 4, no. 1, e11, 2011. https://doi.org/10.18785/jetde.0401.10

A. O. Alkhamisi, M. M. Monowar, “Rise of Augmented Reality: Current and Future Application Areas,” International Journal of Internet and Distributed System, vol. 1, no. 4, pp. 25–34, 2013. https://doi.org/10.4236/ijids.2013.14005

A. Vitzhum, “Towards a structured design of Augmented Reality Applications,” in IEEE VR 2006 Work. “Specification Mix. Real. User Interfaces”, pp. 16–19, 2006,

A. Oliveira, R. B. Araujo, “Creation and visualization of context aware augmented reality interfaces,” in AVI '12: Proceedings of the International Working Conference on Advanced Visual Interfaces, 2021, pp. 324–327. https://doi.org/10.1145/2254556.2254618

C. Kulas, C. Sandor, G. Klinker, “Towards a Development Methodology for Augmented Reality User Interfaces,” in MIXER '04, Exploring the Design and Engineering of Mixed Reality Systems, 2004. http://ceur-ws.org/Vol-91/paperD4.pdf

A. Visser, “Survey of XML Languages for Augmented Reality Content,” in Proceedings Augmented Reality Standard Forum, 2010, pp. 1–7.

A. V. Córdova Gonzales, “Un navegador de realidad aumentada para aplicaciones basadas en marcadores aplicando el estándar ARML 2.0,” Grade Thesis, Universidad Nacional Mayor de San Marcos, Lima, Perú, 2017.

B. Kitchenham, S. Charters, Guidelines for performing Systematic Literature Reviews in Software Engineering, 2007. https://www.elsevier.com/__data/promis_misc/525444systematicreviewsguide.pdf.

H. Ramirez, E. G. Mendivil, P. R. Flores, M. C. Gonzalez, “Authoring software for augmented reality applications for the use of maintenance and training process,” Procedia Computer Science, vol. 25, pp. 189–193, 2013. https://doi.org/10.1016/j.procs.2013.11.023

M. Lechner, “OGC Augmented Reality Markup Language 2.0 (ARML 2.0), Version 1.0,” Open Geospatial Consortium, Wayland, 2015. https://doi.org/10.25607/OBP-600

F. Ledermann, “An authoring framework for augmented reality presentations,” Master Thesis, University of Technology, Vienna, Austria, 2004.

D. Rumiński, K. Walczak, “CARL: A Language for Modelling Contextual Augmented Reality Environments,” IFIP Advances in Information and Communication Technology, vol. 423, no. April 2014, pp. 183–190, 2014. https://doi.org/10.1007/978-3-642-54734-8_21

R. Wojciechowski, “Modeling Interactive Augmented Reality Environments,” in Interactive 3D Multimedia Content: Models for Creation, Management, Search and Presentation, Eds. W. Cellary and K. Walczak. London: Springer London, 2012, pp. 137–170.

A. Vitzthum, “SSIML/AR: A Visual Language for the Abstract Specification of Augmented Reality User Interfaces,” in 3D User Interfaces (3DUI’06), 2006, pp. 135–142. https://doi.org/10.1109/VR.2006.123

B. MacIntyre, A. Hill, H. Rouzati, M. Gandy, B. Davidson, “The Argon AR Web Browser and standards-based AR application environment,” in 10th IEEE International Symposium on Mixed and Augmented Reality, 2011, pp. 65–74. https://doi.org/10.1109/ISMAR.2011.6092371

P. Figueroa, R. Dachselt, I. Lindt, “A Conceptual Model and Specification Language for Mixed Reality Interface Components,” in IEEE 2006 Virtual Reality Workshop, 2006, pp. 1–4.

M. S. Gonzalez, C. L. Gómez, ARUIML: A Three-dimensional User Interface Description Language for Augmented Reality, 2013.

W. Broll, I. Lindt, J. Ohlenburg, A. Linder, A Framework for Realizing Multi-Modal VR and AR User Interfaces, 2005.

C. Sandor, T. Reicher, “CUIML: A language for generating multimodal human-computer interfaces,” in Proceedings of the European UIML Conference, 2001.

Google, KML Reference-Keyhole Markup Language-Google Developers, 2020. https://developers.google.com/kml/documentation/kmlreference

B. MacIntyre, H. Rouzati, M. Lechner, “Walled gardens: apps and data as barriers to augmenting reality,” IEEE Computer Graphics and Applications, vol. 33, no. 3, pp. 77-81, 2013. https://doi.org/10.1109/mcg.2013.51

C. Portele, “OpenGIS® Geography Markup Language (GML) Encoding Standard, Version 3.2.2,” Open Geospatial Consortium, Wayland, 2016. https://doi.org/10.25607/OBP-660

R. Arnaud, M. Barnes, COLLADA: Sailing the gulf of 3D digital content creation, 2006.

Arf, GR ARF 001 - V1.1.1 - Augmented Reality Framework (ARF); AR standards landscape, 2019. https://portal.etsi.org/TB/ETSIDeliverableStatus.aspx

D. Schmalstieg A. Fuhrmann, G. Hesina, Z. Szalavári, L. M. Encarnação, M. Gervautz, W. Purgathofer, “The Studierstube Augmented Reality Project,” Presence: Teleoperators and Virtual Environments, vol. 11, no. 1, pp. 33–54, 2002. https://doi.org/10.1162/105474602317343640

F. Ledermann, D. Schmalstieg, “APRIL: A high-level framework for creating augmented reality presentations,” in IEEE Proceedings. VR, 2005, pp. 187–194. https://doi.org/10.1109/vr.2005.1492773

A. Vitzthum, H. Hussmann, “Modeling augmented reality user interfaces with SSIML/AR,” Journal of Multimedia, vol. 1, no. 3, pp. 13–22, 2006. https://doi.org/10.4304/jmm.1.3.13-22

K. Walczak, D. Rumiński, J. Flotyński, “Building Contextual Augmented Reality Environments with semantics,” in International Conference on Virtual Systems & Multimedia (VSMM), 2014, pp. 353–361. https://doi.org/10.1109/VSMM.2014.7136656

D. Ruminski, K. Walczak, “Dynamic composition of interactive AR scenes with the CARL language,” in 5th International Conference on Information, Intelligence, Systems and Applications, 2014, pp. 329–334. https://doi.org/10.1109/IISA.2014.6878808

D. Ruminski, “Modeling spatial sound in contextual augmented reality environments,” in 6th International Conference on Information, Intelligence, Systems and Applications (IISA), 2015, pp. 1–6. https://doi.org/10.1109/IISA.2015.7387982

K. Walczak, R. Wojciechowski, “Dynamic Creation of Interactive Mixed Reality Presentations,” in Proceedings of the ACM Symposium on Virtual Reality Software and Technology, 2005, pp. 167–176. https://doi.org/10.1145/1101616.1101653

A. Vitzthum, A. Pleuss, “SSIML: Designing Structure and Application Integration of 3D Scenes,” in Proceedings of the Tenth International Conference on 3D Web Technology, 2005, pp. 9–17. https://doi.org/10.1145/1050491.1050493

A. Hill, B. MacIntyre, M. Gandy, B. Davidson, H. Rouzati, “KHARMA: An open KML/HTML architecture for mobile augmented reality applications,” in IEEE International Symposium on Mixed and Augmented Reality, 2010, pp. 233–234. https://doi.org/10.1109/ISMAR.2010.5643583

M. Lechner, “ARML 2.0 in the context of existing AR data formats,” in 6th Workshop on Software Engineering and Architectures for Realtime Interactive Systems (SEARIS), 2013, pp. 41–47. https://doi.org/10.1109/SEARIS.2013.6798107

P. Figueroa, M. Green, H. J. Hoover, “InTml: A Description Language for VR Applications,” in Proceedings of the Seventh International Conference on 3D Web Technology, 2002, pp. 53–58. https://doi.org/10.1145/504502.504511

S. Ahn, H. Ko, B. Yoo, “Webizing mobile augmented reality content,” New Review of Hypermedia and Multimedia, vol. 20, no. 1, pp. 79–100, 2014. https://doi.org/10.1080/13614568.2013.857727

A. Vitzthum, “SSIML/behaviour: Designing behaviour and animation of graphical objects in virtual reality and multimedia applications,” in Seventh IEEE International Symposium on Multimedia (ISM'05), 2005, pp. 159–167. https://doi.org/10.1109/ISM.2005.109

T. Liao, “Standards and Their (Recurring) Stories: How Augmented Reality Markup Language Was Built on Stories of Past Standards,” Science, Technology, & Humam Values, vol. 45, no. 4, pp. 712–737, 2020. https://doi.org/10.1177/0162243919867417

Citado por: