Detection of lies by facial thermal imagery analysis

Sebastián Bedoya-Echeverry, Hernán Belalcázar-Ramírez, Humberto Loaiza-Correa, Sandra Esperanza Nope-Rodríguez, Carlos Rafael Pinedo-Jaramillo, Andrés David Restrepo-Girón

Abstract


An artificial vision system is presented for lie detection by analyzing face thermal image sequences. This system represents an alternative technique to the polygraph. Some of its features are: 1) it has no physical contact with the examinee, 2) it is non-intrusive, 3) it has a potential for private use, and 4) it can simultaneously analyze several persons. The proposed system is based on the detection of physiological changes in temperature in the lacrimal puncta area caused by the subtle increase in blood flow through the nearby vascular network. These changes take place when anxiety appears as a consequence of deception. Thus, the system segments the periorbital area, and tracks consecutive frames using the Kanade-Lucas-Tomasi algorithm. The results show a success rate of 79.2 % in detecting lies using a simple classification based on the comparison between the estimated temperatures in control questions, and the rest of the interrogation procedure. The performance of this system is comparable with previous works, where cameras with better specifications were used.


Keywords


face anthropometric measurements; KLT algorithm; lie detection; periorbital area; thermography

Full Text:

PDF

References


J. Yuille, Credibility Assessment. Dordrecht, The Netherlands: Kluwer Academic Publishers, 1989. DOI: http://doi.org/10.1007/978-94-015-7856-1.

H. D. Benítez-Restrepo, H. Loaiza-Correa, and E. Caicedo-Bravo, Termografía activa pulsada en inspección de materiales. Técnicas Avanzadas de Procesado. Cali, Colombia: Universidad del Valle / Universidad Javeriana, 2011.

B. B. Lahiri, S. Bagavathiappan, T. Jayakumar, and J. Philip, “Medical applications of infrared thermography: a review,” Infrared Physics & Technology, vol. 55(4), pp. 221-235, Jul. 2012. DOI: http://doi.org/10.1016/j.infrared.2012.03.007.

I. Fujimasa, T. Chinzei, and I. Saito, “Converting Far Infrared Image Information to Other Physiological Data,” IEEE Eng. Med. Biol. Mag., vol. 19(3), pp. 71-76, May. 2000. DOI: http://doi.org/10.1109/51.844383.

M. Garbey, A. Merla, and I. Pavlidis, “Estimation of blood flow speed and vessel location from thermal video,” in Proc. 2004 IEEE Computer Society Conf. Computer Vision and Pattern Recognition Conf., Washington D.C., Jul. 2004, vol. 1, pp. 356-363. DOI: http://doi.org/10.1109/cvpr.2004.1315054.

M. Garbey, N. Sun, A. Merla, and I. Pavlidis, “Contact-free measurement of cardiac pulse based on the analysis of thermal imagery,” IEEE Trans. Biomed. Eng., vol. 54(8), pp. 1418-1426, Aug. 2007. DOI: http://doi.org/10.1109/TBME.2007.891930.

I. Pavlidis, J. Levine, and P. Baukol, “Thermal imaging for anxiety detection,” in Proc. IEEE Workshop on Comput. Vis. beyond the Visible

Spectrum: Methods Appl., Hilton Head, SC, 2000, pp. 104-109. DOI: http://doi.org/10.1109/CVBVS.2000.855255.

Z. Zhu, P. Tsiamyrtzis, and I. Pavlidis, “Forehead thermal signature extraction in lie detection,” in Proc. Annu. Int. Conf. IEEE Engineering in Medicine and Biology Society, Paris, France, 2007, pp. 243-246. DOI: http://doi.org/10.1109/iembs.2007.4352269.

U. Jain, B. Tan, and Q. Li, “Concealed knowledge identification using facial thermal imaging,” in Proc. IEEE Int. Conf. Acoustics, Speech and Signal Processing (ICASSP), Kyoto, Japan, 2012, pp. 1677-1680. DOI: http://doi.org/10.1109/icassp.2012.6288219.

I. Pavlidis and J. Levine, “Thermal image analysis for polygraph testing,” IEEE Eng. Med. Biol. Mag., vol. 21(6), pp. 56-64, Nov. 2002. DOI: http://doi.org/10.1109/MEMB.2002.1175139.

M. Owayjan, A. Kashour, N. Al Haddad, M. Fadel, and G. Al Souki, “The design and development of a Lie Detection System using facial micro-expressions,” in 2nd Int. Conf. Advances in Computational Tools for Engineering Applications, Beirut, Lebanon, 2012, pp. 33-38. DOI: http://doi.org/10.1109/ictea.2012.6462897.

J. Gao, N. Rao, Y. Yang, and W. Wei, “A New Lie Detection Method Based on Small-number of P300 Responses,” in Int. Conf. Biomedical Engineering and Biotechnology, Macau, China, 2012, pp. 662–665. DOI: http://doi.org/10.1109/icbeb.2012.31.

Y. Xiong, Y. Luo, W. Huang, W. Zhang, Y. Yang, and J. Gao, “A novel classification method based on ICA and ELM: a case study in lie detection,” Bio-Medical Materials and Engineering, vol. 24(1), pp. 357-63, 2014. DOI: http://doi.org/10.3233/BME-130818.

S. Corral, J. Otero, A. Barrenetxea, and O. Landeta, “Información y Test de Conocimiento Culpable en la Detección del Engaño,” Psicológica, vol. 19(3), pp. 187-200, 1998.

I. Pavlidis and J. Levine, “Monitoring of periorbital blood flow rate through thermal image analysis and its application to polygraph testing,” in Proc. 23rd Annu. Int. Conf. IEEE Engineering in Medicine and Biology, Istanbul (Turkey), Oct. 2001, vol. 3, pp. 2826-2829. DOI: http://doi.org/10.1109/iembs.2001.1017374.

X. Xu, S. Xu, L. Jin, and E. Song, “Characteristic analysis of Otsu threshold and its applications,” Pattern Recognition Letters, vol. 32(7), pp. 956-961, May. 2011. DOI: http://doi.org/10.1016/j.patrec.2011.01.021.

C. Tomasi and T. Kanade, “Detection and Tracking of Point Features,” Carnegie Mellon Univ, PA, Tech Rep. CMU-CS-91-132, Apr. 1991.

J. Shi and C. Tomasi, “Good Features to Track,” in Proc. IEEE Conf. Computer Vision and Pattern Recognition, Seattle, WA, Jun. 1994 pp. 593-600.

D. Otero, Fusión de secuencias de vídeo de alta velocidad procedentes de cámaras desplazadas espacial o temporalmente, undergraduate project, Escuela Politécnica Superior, Univ. Autónoma de Madrid. Madrid, España, 2010.

M. Zamorano, “Análisis de señales mediante STFT y Wavelet. Aplicación a defectología en rodamientos,” undergraduate project, Departamento de Ingeniería Mecánica, Universidad Carlos III de Madrid, 2010.

M. Misiti, Y. Misiti, G. Oppenheim, and J. M. Poggi, Wavelet toolboxTM. User´s Guide. Natick, MA: The MathWorks Inc., 1996.

D. Shastri, P. Tsiamyrtzis, and I. Pavlidis, “Periorbital thermal signal extraction and applications,” in Proc. Annu. Int. Conf. IEEE Engineering in Medicine and Biology Society, Vancouver, Canada, 2008, pp. 102-5. DOI: http://doi.org/10.1109/iembs.2008.4649101.

P. Buddharaju, J. Dowdall, P. Tsiamyrtzis, D. Shastri, I. Pavlidis, and M. G. Frank, “Automatic thermal monitoring system (ATHEMOS) for deception detection,” in IEEE Computer Society Conf. Computer Vision and Pattern Recognition (CVPR’05), San Diego, CA, 2005, vol. 2, pp. 1179-1179. DOI: http://doi.org/10.1109/cvpr.2005.82.

H. Belalcázar and S. Bedoya, Detección de Mentiras por Análisis de Imágenes Térmicas de Rostros, undergraduate project, Escuela de Ingeniería Eléctrica y Electrónica, Univ. del Valle. Cali, Colombia, 2015.




DOI: https://doi.org/10.19053/01211129.v26.n44.2017.5771

Article Metrics

Abstract Views
326




Metrics Loading ...
_

Refbacks

  • There are currently no refbacks.




Copyright (c) 2017 Revista Facultad de Ingeniería

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

__________________________________________________________________________________________________________________

Revista Facultad de Ingeniería (Rev. Fac. Ing.) - ISSN: 0121-1129 - ISSN: 2357-5328 (Online)

Indexed and registered by: Emerging Sources Citation IndexSciELORedalycPublindex(Categoría A2)REDIBDOAJDialnetSHERPA/RoMEOLatindex.

__________________________________________________________________________________________________________________

__________________________________________________________________________________________________________________

Licencia de Creative Commons

This work is licensed under a Creative Commons Attribution 4.0 International

UNIVERSIDAD PEDAGÓGICA Y TECNOLÓGICA DE COLOMBIA
Sede Central Tunja–Boyacá–Colombia
Avenida Central del Norte 39-115
PBX: (57+8) 7405626
portalweb@uptc.edu.co Comentarios de este sitio
Horario de atención y servicio telefónico
8:00 a.m. a 12:00 m y 2:00 p.m a 6:00 p.m.

Atención al Ciudadano
Línea Gratuita: 01 8000 942024
Tel: (57+8) 7428263
quejas.reclamos@uptc.edu.co
Notificaciones Judiciales
Notificaciones de aviso

Institución de Educación Superior sujeta a inspección y vigilancia por el Ministerio de Educación Nacional
Sistema OJS - Metabiblioteca |