Real Time Lip Reading System Implementation in Embedded Environment 


Vol. 17,  No. 3, pp. 227-232, Jun.  2010
10.3745/KIPSTB.2010.17.3.227


PDF
  Abstract

This paper proposes the real time lip reading method in the embedded environment. The embedded environment has the limited sources to use compared to existing PC environment, so it is hard to drive the lip reading system with existing PC environment in the embedded environment in real time. To solve the problem, this paper suggests detection methods of lip region, feature extraction of lips, and awareness methods of phonetic words suitable to the embedded environment. First, it detects the face region by using face color information to find out the accurate lip region and then detects the exact lip region by finding the position of both eyes from the detected face region and using the geometric relations. To detect strong features of lighting variables by the changing surroundings, histogram matching, lip folding, and RASTA filter were applied, and the properties extracted by using the principal component analysis(PCA) were used for recognition. The result of the test has shown the processing speed between 1.15 and 2.35 sec. according to vocalizations in the embedded environment of CPU 806Mhz, RAM 128MB specifications and obtained 77% of recognition as 139 among 180 words were recognized.

  Statistics
  Cite this article

[IEEE Style]

Y. U. Kim, S. K. Kang, S. T. Jung, "Real Time Lip Reading System Implementation in Embedded Environment," The KIPS Transactions:PartB , vol. 17, no. 3, pp. 227-232, 2010. DOI: 10.3745/KIPSTB.2010.17.3.227.

[ACM Style]

Young Un Kim, Sun Kyung Kang, and Sung Tae Jung. 2010. Real Time Lip Reading System Implementation in Embedded Environment. The KIPS Transactions:PartB , 17, 3, (2010), 227-232. DOI: 10.3745/KIPSTB.2010.17.3.227.

Forms

Search
(IN TITLE, AUTHOR, ABSTRACT,KEYWORDS)

Advanced Search ▼

POPULAR KEYWORDS
(TOP 10 KEYWORDS)

Recent Publications
(LAST 3 YEARS)

Old Journals

Indexing

All publications of TKIPS is indexed in DOI, EBSCO, Google Scholar, Crossref, and CrossCheck.

TKIPS is also selected as the Journal for Accreditation by NRF (National Research Foundation of Korea).

Related Journals