Photogrammetry for Augmented Reality, A Low-Cost Method Applied to 3D Modeling in Secondary Schools
Abstract
Augmented Reality (AR) is an emerging technology known for supporting the educational process at different levels, and that is complemented and enhanced nowadays with the increased use of mobile devices. In this sense, some barriers have been identified both in practice and in the literature that minimize the development of mobile applications with this technology, mainly at the levels of elementary school and high school; one of them is 3D modeling, which may take longer and, at the same time, become a challenging process at that educational level. To address this concern, we have designed a method aimed at users with low digital knowledge, and it is complemented with a series of recommendations that allow the use of the photogrammetry technique to generate three-dimensional models in an easy, affordable, and low-cost way. To validate the method, a co-creation team of teachers and tenth-grade students was created and given the task of building 3D objects for three mobile applications developed around different subjects. Subsequently, the evaluation was carried out from two perspectives: a) the co-creation group analyzed the quality of each of the objects generated, b) the applications were evaluated by a group of experts on the subject, taking into account their performance according to usability heuristics. It was a case study where the students also participated in the evaluation of an application. When following the proposed method, the quality and results of the applications evidenced a promising future for developments in the educational field, even for other levels of study.
Keywords
augmented reality, ICT, photogrammetry, 3D modeling, 3D objects
Author Biography
Jairo-Hernando Quintero-Madroñero
Roles: research, methodology, writing - original draft, formal analysis.
Silvia-Margarita Baldiris-Navarro
Roles: writing - review and editing, formal analysis.
Jhoni-Ricardo Cerón-Cháves
Roles: writing - review and editing, formal analysis.
Daniel Burgos
Roles: writing - review and editing, formal analysis.
Yerson Muñoz-Erazo
Roles: investigation, writing - review and editing, methodology.
Luis-Carlos Jurado-Ortega
Roles: investigation, writing - review and editing, methodology.
Edinson-José Meneses-Díaz
Roles: investigation, writing - review and editing, methodology.
References
- F. Brazuelo-Grund, D. J. Gallego-Gil, M. L. Cacheiro-González, "Los docentes ante la integración educativa del teléfono móvil en el aula," RED. Revista de Educación a Distancia, no. 52, e6, 2017. https://doi.org/10.6018/red/52/6 DOI: https://doi.org/10.6018/red/52/6
- D. Chatzopoulos, C. Bermejo, Z. Huang, P. Hui, "Mobile Augmented Reality Survey: From Where We Are to Where We Go," IEEE Access, vol. 5, pp. 6917-6950, 2017. https://doi.org/10.1109/ACCESS.2017.2698164 DOI: https://doi.org/10.1109/ACCESS.2017.2698164
- I. Kazanidis, N. Pellas, A. Christopoulos, "A Learning Analytics Conceptual Framework for Augmented Reality-Supported Educational Case Studies," MTI, vol. 5, no. 3, p. 9, 2021. https://doi.org/10.3390/mti5030009 DOI: https://doi.org/10.3390/mti5030009
- R. Azuma, M. Billinghurst, G. Klinker, "Special Section on Mobile Augmented Reality," Computers & Graphics, vol. 35, no. 4, pp. 7-8, 2011. https://doi.org/10.1016/j.cag.2011.05.002 DOI: https://doi.org/10.1016/j.cag.2011.05.002
- R. Azuma, Y. Baillot, R. Behringer, S. Feiner, S. Julier, B. MacIntyre, "Recent advances in augmented reality," IEEE Computer Graphics and Applications, vol. 21, no. 6, pp. 34-47, 2001. https://doi.org/10.1109/38.963459 DOI: https://doi.org/10.1109/38.963459
- B. Sanii, "Creating Augmented Reality USDZ Files to Visualize 3D Objects on Student Phones in the Classroom," Journal of Chemical Education, vol. 97, no. 1, pp. 253-257, 2020. https://doi.org/10.1021/acs.jchemed.9b00577 DOI: https://doi.org/10.1021/acs.jchemed.9b00577
- J. Cubillo, S. Martin, M. Castro, G. Diaz, A. Colmenar, I. Boticki, "A learning environment for augmented reality mobile learning," in Proceedings IEEE Frontiers in Education Conference, Spain, 2014, pp. 1-8. https://doi.org/10.1109/FIE.2014.7044039 DOI: https://doi.org/10.1109/FIE.2014.7044039
- J. Barroso Osuna, J. J. Gutiérrez-Castillo, M. del C. Llorente-Cejudo, R. Valencia Ortiz, "Difficulties in the Incorporation of Augmented Reality in University Education: Visions from the Experts," Journal of New Approaches in Educational Research, vol. 8, no. 2, pp. 126-141, 2019. https://doi.org/10.7821/naer.2019.7.409 DOI: https://doi.org/10.7821/naer.2019.7.409
- E. Ch'ng, S. Cai, T. E. Zhang, F.-T. Leow, "Crowdsourcing 3D cultural heritage: best practice for mass photogrammetry," Journal of Cultural Heritage Management and Sustainable Development, vol. 9, no. 1, pp. 24-42, 2019. https://doi.org/10.1108/JCHMSD-03-2018-0018 DOI: https://doi.org/10.1108/JCHMSD-03-2018-0018
- G. Mora, J. Leandro, TRANZYXION. Prótesis virtuales mediante fotogrametría y realidad aumentada, Grade Thesis, Universitat Politecnica de Valencia, Spain, 2021. https://riunet.upv.es/handle/10251/160056
- A. A. H. Aljabar, A. B. Cahyono, H. Hidayat, "Application of augmented reality and close range photogrammetry technology for mapping of cultural heritage areas (case study: Ai Renung Site, Sumbawa Regency)," IOP Conference Series: Earth and Environmental Science, vol. 389, e012037, 2019. https://doi.org/10.1088/1755-1315/389/1/012037 DOI: https://doi.org/10.1088/1755-1315/389/1/012037
- P. J. Juan Gutiérrez, R. Irles Parreño, R. Maestre López-Salazar, "Tiempo de fotogrametría. Una propuesta de clasificación para el levantamiento fotogramétrico," EGE Revista de Expresión Gráfica en la Edificación, no. 13, pp. 30-46, 2020. https://doi.org/10.4995/ege.2020.14579 DOI: https://doi.org/10.4995/ege.2020.14579
- F. Carvajal-Ramírez, A. D. Navarro-Ortega, F. Agüera-Vega, P. Martínez-Carricondo, "Unmanned aerial vehicle photogrammetry and 3d modeling applied to virtual reconstruction of an archaeological site in the bronce age," International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. XLII-2/W15, pp. 279-284, 2019. https://doi.org/10.5194/isprs-archives-XLII-2-W15-279-2019 DOI: https://doi.org/10.5194/isprs-archives-XLII-2-W15-279-2019
- C. Portalés, J. L. Lerma, S. Navarro, "Augmented reality and photogrammetry: A synergy to visualize physical and virtual city environments," ISPRS Journal of Photogrammetry and Remote Sensing, vol. 65, no. 1, pp. 134-142, 2010. https://doi.org/10.1016/j.isprsjprs.2009.10.001 DOI: https://doi.org/10.1016/j.isprsjprs.2009.10.001
- B. Carrión-Ruiz, S. Blanco-Pons, A. Weigert, S. Fai, J. L. Lerma, "Merging photogrammetry and augmented reality: the canadian library of parliament," International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. XLII-2/W11, pp. 367-371, 2019. https://doi.org/10.5194/isprs-archives-XLII-2-W11-367-2019 DOI: https://doi.org/10.5194/isprs-archives-XLII-2-W11-367-2019
- E. Y. Putra, A. K. Wahyudi, C. Dumingan, "A proposed combination of photogrammetry, Augmented Reality and Virtual Reality Headset for heritage visualization," in International Conference on Informatics and Computing, Indonesia, 2016, pp. 43-48. https://doi.org/10.1109/IAC.2016.7905687 DOI: https://doi.org/10.1109/IAC.2016.7905687
- G. Tucci, A. Conti, L. Fiorini, F. Panighini, E. I. Parisi, "Education and training resources on digital photogrammetry," International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. XLII-5, pp. 45-50, 2018. https://doi.org/10.5194/isprs-archives-XLII-5-45-2018 DOI: https://doi.org/10.5194/isprs-archives-XLII-5-45-2018
- M. Gil-Docampo, J. Ortiz-Sanz, T. Rego-Sanmartin, M. Arza-Garcia, "A World Wide Web-Based Practice That Disseminates Photogrammetry: Inspiring Secondary Students to Pursue Geomatics Careers [Education]," IEEE Geoscience and Remote Sensing Magazine, vol. 7, no. 1, pp. 86-97, 2019. https://doi.org/10.1109/MGRS.2018.2876565 DOI: https://doi.org/10.1109/MGRS.2018.2876565
- I. Kravchenko, T. Luhmann, R. Shults, "Concept and practice of teaching technical university students to modern technologies of 3d data acquisition and processing: a case study of close-range photogrammetry and terrestrial laser scanning," International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. XLI-B6, pp. 65-69, 2016. https://doi.org/10.5194/isprs-archives-XLI-B6-65-2016 DOI: https://doi.org/10.5194/isprsarchives-XLI-B6-65-2016
- H. Naik, Y. Oyamada, P. Keitler, N. Navab, "Exploiting Photogrammetric Targets for Industrial AR," in IEEE International Symposium on Mixed and Augmented Reality, Japan, 2015, pp. 144-147. https://doi.org/10.1109/ISMAR.2015.42 DOI: https://doi.org/10.1109/ISMAR.2015.42
- T. Luhmann, "Learning Photogrammetry with Interactive Software Tool PhoX," International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. XLI-B6, pp. 39-44, 2016. https://doi.org/10.5194/isprsarchives-XLI-B6-39-2016 DOI: https://doi.org/10.5194/isprsarchives-XLI-B6-39-2016
- I. Kournoutas, V. Vigo, R. Chae, M. Wang, J. GurrolaII, A. A. Abla, I. El-Sayed, R. Rodriguez-Rubio, "Acquisition of Volumetric Models of Skull Base Anatomy Using Endoscopic Endonasal Approaches: 3D Scanning of Deep Corridors Via Photogrammetry," World Neurosurgery, vol. 129, pp. 372-377, 2019. https://doi.org/10.1016/j.wneu.2019.05.251 DOI: https://doi.org/10.1016/j.wneu.2019.05.251
- K. M. Wesencraft, J. A. Clancy, "Using Photogrammetry to Create a Realistic 3D Anatomy Learning Aid with Unity Game Engine," Biomedical Visualization, Springer International Publishing, 2019, pp. 93-104. https://doi.org/10.1007/978-3-030-31904-5_7 DOI: https://doi.org/10.1007/978-3-030-31904-5_7
- B. A. Vera, E. B. Ibáñez, I. K. R. Parada, "Metodología para documentación 3D utilizando fotogrametría digital," Revista Tecnura, vol. 19, no. 3, pp. 113-120, 2015
- P. Waldhausl, C. Ogleby, "Close Range Techniques and Machine Vision," in ISPRS Commission V Symposium, Australia, 1994. https://doi.org/10.1111/j.1477-9730.1994.tb00300.x DOI: https://doi.org/10.1111/j.1477-9730.1994.tb00300.x
- J. Quintero, Saavedra, Johann, J. Cerón, "Co-creación desde el colegio, para generar recursos educativos digitales con realidad aumentada para diferentes áreas," Revista Teknos, vol. 19, pp. 37-44, 2019. https://doi.org/10.25044/25392190.989 DOI: https://doi.org/10.25044/25392190.989
- T. Dovramadjiev, "Modern accessible application of the system Blender in 3D design practice," Science & Technologies, vol. 4, no. 4, p. 4, 2015.
- L. B. Cassar, F. Inguanez, "ARC: Augmented Reality for Catering," in IEEE 8th International Conference on Consumer Electronics, German, 2018, pp. 1-5. https://doi.org/10.1109/ICCE-Berlin.2018.8576165 DOI: https://doi.org/10.1109/ICCE-Berlin.2018.8576165
- A. Jeremy, J. Duncan, "Using 3D Photogrammetry to Create Open-Access Models of Live Animals: 2D and 3D Software Solutions," in 3D/CR in the Academic Library: Emerging practices and trends, 2019, p. 139
- M. Sarosa, A. Chalim, S. Suhari, Z. Sari, H. B. Hakim, "Developing augmented reality based application for character education using unity with Vuforia SDK," Journal of Physics: Conference Series, vol. 1375, e012035, 2019. https://doi.org/10.1088/1742-6596/1375/1/012035 DOI: https://doi.org/10.1088/1742-6596/1375/1/012035
- D. Parras-Burgos, D. G. Fernández-Pacheco, F. Cavas-Martínez, J. Nieto, F. J. F. Cañavate, "Initiation to Reverse Engineering by Using Activities Based on Photogrammetry as New Teaching Method in University Technical Studies", in Universal Access in Human-Computer Interaction. Theory, Methods and Tools, vol. 11572, M. Antona and C. Stephanidis, Eds. Cham: Springer International Publishing, 2019, pp. 159-176. https://doi.org/10.1007/978-3-030-23560-4_12 DOI: https://doi.org/10.1007/978-3-030-23560-4_12
- M. De Paiva Guimaraes, V. F. Martins, "A Checklist to Evaluate Augmented Reality Applications," in XVI Symposium on Virtual and Augmented Reality, Salvador, 2014, pp. 45-52. https://doi.org/10.1109/SVR.2014.17 DOI: https://doi.org/10.1109/SVR.2014.17
- G. L. A. Mota, J. L. Nunes, S. Brito, J. Araújo, O. B. Filho, M. Teixeira Silveira, R. Alves de Aguiar, I. da Silva Badolato, S. Lustosa da Costa, P. Farias Reolon, "The E-Foto Project and the Research to Implement a GNU/GPL Open source Educational Digital Photogrammetric Workstation," in Geospatial Free and Open Source Software in the 21st Century, E. Bocher and M. Neteler, Eds. Berlin, Heidelberg: Springer Berlin Heidelberg, 2012, pp. 89-106. https://doi.org/10.1007/978-3-642-10595-1_6 DOI: https://doi.org/10.1007/978-3-642-10595-1_6
- Unity - Manual: Optimizando el Rendimiento Gráfico. https://docs.unity3d.com/es/530/Manual/OptimizingGraphicsPerformance.html
- C. Erolin, "Interactive 3D Digital Models for Anatomy and Medical Education," in Biomedical Visualisation, vol. 1138, P. M. Rea, Ed. Cham: Springer International Publishing, 2019, pp. 1-16. https://doi.org/10.1007/978-3-030-14227-8_1 DOI: https://doi.org/10.1007/978-3-030-14227-8_1