Dual silent communication system development based on subvocal speech and Raspberry Pi

Authors

  • José Daniel Ramírez-Corzo Universidad de Pamplona (Pamplona-Norte de Santander, Colombia).
  • Luis Enrique Mendoza Universidad de Pamplona (Pamplona-Norte de Santander, Colombia).

DOI:

https://doi.org/10.19053/01211129.v25.n43.2016.5304

Keywords:

entropy, Raspberry Pi, silent communication, SVM (Support Vector Machines), subvocal speech, Wavelet

Abstract

This paper presents a novel methodology to develop a silent dual communication based on subvocal speech. Two electronic systems were developed for people’s wireless communication. The system has 3 main stages. The first stage is the subvocal speech electromyographic signals acquisition, in charge to extract, condition, encode and transmit the system development. This signals were digitized and registered from the throat and sent to an embedded a raspberry pi.

In this device was implemented the processing, as it is called the second stage, which besides to store, assumes conditioning, extraction and pattern classification of subvocal speech signals. Mathematical techniques were used as Entropy, Wavelet analysis, Minimal Squares and Vector Support Machines, which were applied in Python free environment program. Finally, in the last stage in charge to communicate by wireless means, were developed the two electronic systems, by using 4 signal types, to classify the words: Hello, intruder, hello how are you? and I am cold to perform the silent communication.

Additionally, in this article we show the speech subvocal signals’ recording system realization. The average accuracy percentage was 72.5 %, and includes a total of 50 words by class, this is 200 signals. Finally, it demonstrated that using the Raspberry Pi it is possible to set a silent communication system, using subvocal. speech signals.

Downloads

Download data is not yet available.

References

C. Jorgensen and K. Binsted, "Web Browser Control Using EMG Based Sub Vocal Speech Recognition," in Proceedings of the 38th Annual Hawaii International Conference on System Sciences, p. 294c, Jan. 2005. DOI: http://dx.doi.org/10.1109/HICSS.2005.683. DOI: https://doi.org/10.1109/HICSS.2005.683

J. Mendes, R. Robson, S. Labidi, and A. Barros, "Subvocal Speech Recognition Based on EMG Signal Using Independent Component Analysis and Neural Network MLP," in Congress on Image and Signal Processing, vol. 1, pp. 221-224, May. 2008. DOI: http://dx.doi.org/10.1109/cisp.2008.741. DOI: https://doi.org/10.1109/CISP.2008.741

H. Curtis and L. F. Petrinovich, "Treatment of Subvo-cal Speech During Reading," Journal of Reading, vol. 12 (5), pp. 361-368, Feb. 1969.

E. N. Gamma, D. Amaya, and O. L. Ramos, "Revisión de las tecnologías y aplicaciones del habla subvocal," Ingeniería, vol. 20 (2), pp. 277-288, 2015. DOI: http://dx.doi.org/10.14483/udistrital.jour.reving.2015.2.a07. DOI: https://doi.org/10.14483/23448393.8513

J. A. Gutiérrez, E. N. Gamma, D. Amaya, and O. F. Avilés, "Desarrollo de interfaces para la detección del habla sub-vocal," Tecnura, vol. 17(37), pp. 138 - 152, Jul. 2013. DOI: http://dx.doi.org/10.14483/udistrital.jour.tecnura.2013.3.a12. DOI: https://doi.org/10.14483/udistrital.jour.tecnura.2013.3.a12

R. Merletti and P. Philip A, Electromyography Physiology, Engineering, and Noninvasive Applications, 2004. DOI: https://doi.org/10.1002/0471678384

J. Peña Rodriguez and L. E. Mendoza, Adquisición y procesamiento de señales electromiográficas basadas en habla subvocal, Pamplona, Dec. 2010.

L. E. Mendoza, J. Peña, L. A. Muñoz-Bedoya, and H. J. Velandia-Villamizar, "Procesamiento de señales provenientes del habla subvocal usando Wavelet Packet y Redes Neuronales," Tecno. Lógicas, vol. Edición Especial 2013, pp. 655-667, Oct. 2013. DOI: https://doi.org/10.22430/22565337.371

I. Ishii, S. Takemoto, T. Takaki, M. Takamoto, K. Imon, and K. Hirakawa, "Real-time laryngoscopic measurements of vocal-fold vibration," in 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 6623-6626, Aug. 2011. DOI: http://dx.doi.org/10.1109/IEMBS.2011.6091633. DOI: https://doi.org/10.1109/IEMBS.2011.6091633

G. Chau and G. Kemper, "One Channel Subvocal Speech Phrases Recognition Using Cumulative Residual Entropy and Support Vector Machines," IEEE Latin American Transactions, vol. 13 (7), pp. 2135-2143, Jul. 2015. DOI: http://dx.doi.org/10.1109/TLA.2015.7273769. DOI: https://doi.org/10.1109/TLA.2015.7273769

C. Jorgensen, D. D. Lee, and S. Agabont, "Sub Auditory Speech Recognition Based on EMG Signals," Proceedings of the International Joint Conference on Neural Networks, vol. 4, pp. 3128-3133, Jul. 2003. DOI: http://dx.doi.org/10.1109/ijcnn.2003.1224072. DOI: https://doi.org/10.1109/IJCNN.2003.1224072

L. E. Mendoza, J. Peña, and J. L. Ramón, " Electro-myographic patterns of sub-vocal Speech: Records and classification," Revista de Tecnologia, vol. 12 (2), pp. 35-41, Jul. 2013. DOI: https://doi.org/10.18270/rt.v12i2.758

SENIAM, [en línea]. Available: http://www.seniam.org/. [acceso: 09/02/2016].

Texas Instrument, [en línea]. Available: http://www.ti.com/lit/ds/symlink/ina128.pdf. [acceso: 23/09/2015].

TEXAS INSTRUMENT, [en línea]. Available: http://www.ti.com/lit/ds/symlink/ads7813.pdf. [acceso: 23/09/2015].

Raspberry Pi, [en línea]. Available: https://www.raspberrypi.org/education/. [acceso: 01/01/2014].

C. Sidney, R. Gopinath, and H. Guo, Introduction to Wavelets and Wavelet Transforms: A Primer, Pearson, 1997.

Downloads

Published

2016-09-01
Metrics
Views/Downloads
  • Abstract
    1395
  • PDF (Español)
    645
  • HTML (Español)
    942

How to Cite

Ramírez-Corzo, J D, & Mendoza, L E. (2016). Dual silent communication system development based on subvocal speech and Raspberry Pi. Revista Facultad de Ingeniería, 25(43), 111–121. https://doi.org/10.19053/01211129.v25.n43.2016.5304
Crossref
Scopus
Google Scholar
Europe PMC

Issue

Vol. 25 No. 43 (2016)

Section

Papers

License

All articles included in the Revista Facultad de Ingeniería are published under the Creative Commons (BY) license.

Authors must complete, sign, and submit the Review and Publication Authorization Form of the manuscript provided by the Journal; this form should contain all the originality and copyright information of the manuscript.

The authors who publish in this Journal accept the following conditions:

a. The authors retain the copyright and transfer the right of the first publication to the journal, with the work registered under the Creative Commons attribution license, which allows third parties to use what is published as long as they mention the authorship of the work and the first publication in this Journal.

b. Authors can make other independent and additional contractual agreements for the non-exclusive distribution of the version of the article published in this journal (eg, include it in an institutional repository or publish it in a book) provided they clearly indicate that the work It was first published in this Journal.

c. Authors are allowed and recommended to publish their work on the Internet (for example on institutional or personal pages) before and during the process.
review and publication, as it can lead to productive exchanges and a greater and faster dissemination of published work.

d. The Journal authorizes the total or partial reproduction of the content of the publication, as long as the source is cited, that is, the name of the Journal, name of the author (s), year, volume, publication number and pages of the article.

e. The ideas and statements issued by the authors are their responsibility and in no case bind the Journal.

Most read articles by the same author(s)