Recent advances in the fields of computer vision, pattern recognition, and signal processing has led to a growing interest in automating this challenging task of lip reading. The ability to lip read enables a person with a hearing impairment to communicate with others and to engage in social activities, which otherwise would be difficult. The research will be presented on September 12 at the International Conference on Auditory-Visual Speech Processing (AVSP) 2009 at the University of East Anglia.Eligible for voucher ISBN-13: 978-3-8443-1079-5 ISBN-10: 3844310797 EAN: 9783844310795 Book language:īlurb/Shorttext: Lip reading is used to understand or interpret speech without hearing it, a technique especially mastered by people with hearing difficulties.
Keynote speakers will be Dr Peter Bull of the University of York who will be exploring The Myth of Body Language and Prof Louis Goldstein of the University of Southern California whose presentation is entitled Articulatory Phonology and Audio-Visual Speech. Topics under discussion will include: machine recognition of audiovisual speech the role of gestures accompanying speech modeling, synthesis and recognition of facial gestures and speech synthesis. The University of East Anglia will host cutting edge researchers including psychologists, engineers, scientists and linguists from as far afield as Australia, Canada and Japan.Īs part of the conference, delegates will take part in a Visual Speech Synthesis Challenge in which a number of visual speech synthesizers, or 'talking heads', will battle it out to determine the most intelligible and visually appealing system.ĪVSP runs as a satellite conference to Interspeech 2009 which will be held in Brighton. The AVSP conference is being held in the UK for the first time since its inception in 1998. Hearing loss affects 55 per cent of people over 60 so, with the ageing population, demand to learn lip-reading is only going to increase." We would welcome the development of video-based or online training resources to supplement the teaching of lip-reading. We hope this research will represent a real technological advance for the deaf community."Īgnes Hoctor, campaigns manager at the RNID, said: "This research confirms how difficult the vital skill of lip-reading is to learn and why RNID is campaigning for people who are deaf or hard of hearing to have improved access to classes.
"With just four hours of training it helped them improve their lip-reading skills markedly. "This pilot study is the first time an automated lip-reading system has been benchmarked against human lip-readers and the results are perhaps surprising," said the study's lead author Sarah Hilder. It is hoped this research might lead to novel methods of lip-reading training for the deaf and hard of hearing. Using a new video-based training system, viewers with very limited training significantly improved their ability to lip-read monosyllabic words, which in itself is a very difficult task.
Automated lip reading full#
The study also showed that rather than the traditional approach to lip-reading training, in which viewers are taught to spot key lip-shapes from static (often drawn) images, the dynamics and the full appearance of speech gestures are very important. The peer-reviewed findings will be presented for the first time at the eighth International Conference on Auditory-Visual Speech Processing (AVSP) 2009, held at the University of East Anglia from September 10-13. They found that the automated system significantly outperformed the human lip-readers – scoring a recognition rate of 80 per cent, compared with only 32 per cent for human viewers on the same task.įurthermore, they found that machines are able to exploit very simplistic features that represent only the shape of the face, whereas human lip-readers require full video of people speaking. A research team from the School of Computing Sciences at UEA compared the performance of a machine-based lip-reading system with that of 19 human lip-readers.
0 kommentar(er)
