1 |
Multistream neural architectures for cued-speech recognition using a pre-trained visual feature extractor and constrained CTC decoding
|
|
|
|
In: ICASSP 2022 - IEEE International Conference on Acoustics, Speech and Signal Processing ; https://hal.archives-ouvertes.fr/hal-03578503 ; ICASSP 2022 - IEEE International Conference on Acoustics, Speech and Signal Processing, May 2022, Singapour, Singapore (2022)
|
|
BASE
|
|
Show details
|
|
2 |
Multistream neural architectures for cued-speech recognition using a pre-trained visual feature extractor and constrained CTC decoding
|
|
|
|
In: ICASSP 2022 - IEEE International Conference on Acoustics, Speech and Signal Processing ; https://hal.archives-ouvertes.fr/hal-03578503 ; ICASSP 2022 - IEEE International Conference on Acoustics, Speech and Signal Processing, May 2022, Singapour, Singapore (2022)
|
|
Abstract:
International audience ; This paper proposes a simple and effective approach for automatic recognition of Cued Speech (CS), a visual communication tool that helps people with hearing impairment to understand spoken language with the help of hand gestures that can uniquely identify the uttered phonemes in complement to lipreading. The proposed approach is based on a pre-trained hand and lips tracker used for visual feature extraction and a phonetic decoder based on a multistream recurrent neural network trained with connectionist temporal classification loss and combined with a pronunciation lexicon. The proposed system is evaluated on an updated version of the French CS dataset CSF18 for which the phonetic transcription has been manually checked and corrected. With a decoding accuracy at the phonetic level of 70.88%, the proposed system outperforms our previous CNN-HMM decoder and competes with more complex baselines.
|
|
Keyword:
[SHS.INFO]Humanities and Social Sciences/Library and information sciences; cued speech; hearing impairment; multi-modality; neural network; Visual speech
|
|
URL: https://hal.archives-ouvertes.fr/hal-03578503/file/sankar-ICASSP2022-VF.pdf https://hal.archives-ouvertes.fr/hal-03578503/document https://hal.archives-ouvertes.fr/hal-03578503
|
|
BASE
|
|
Hide details
|
|
3 |
Cochlear Implant Results in Older Adults with Post-Lingual Deafness: The Role of “Top-Down” Neurocognitive Mechanisms
|
|
|
|
In: International Journal of Environmental Research and Public Health; Volume 19; Issue 3; Pages: 1343 (2022)
|
|
BASE
|
|
Show details
|
|
4 |
PREVALENCE OF HEARING LOSS AMONG CHILDREN PRESENTING IN ENT OUTDOOR DEPARTMENT ...
|
|
|
|
BASE
|
|
Show details
|
|
5 |
PREVALENCE OF HEARING LOSS AMONG CHILDREN PRESENTING IN ENT OUTDOOR DEPARTMENT ...
|
|
|
|
BASE
|
|
Show details
|
|
6 |
Καταγραφή του οδοντιατρικού φόβου, της οδοντικής τερηδόνας και της υγείας των ούλων σε παιδιά και εφήβους με προβλήματα ακοής στην Ελλάδα ...
|
|
|
|
BASE
|
|
Show details
|
|
7 |
Data from: "The roles of cognitive abilities and hearing acuity in older adults' recognition of words taken from fast and spectrally reduced speech" ...
|
|
|
|
BASE
|
|
Show details
|
|
8 |
Morpho-Syntactic Deficit in Children with Cochlear Implant: Consequence of Hearing Loss or Concomitant Impairment to the Language System?
|
|
|
|
In: International Journal of Environmental Research and Public Health ; Volume 18 ; Issue 18 (2021)
|
|
BASE
|
|
Show details
|
|
9 |
Design of Educational Tools Based on Traditional Games for the Improvement of Social and Personal Skills of Primary School Students with Hearing Impairment
|
|
|
|
In: Sustainability ; Volume 13 ; Issue 22 (2021)
|
|
BASE
|
|
Show details
|
|
10 |
Detección precoz de la hipoacusia, influencia en el diagnóstico y en el tratamiento temprano
|
|
|
|
BASE
|
|
Show details
|
|
11 |
Модификация городских названий в речевой деятельности ребенка ; City Place Names and their Modifi cation in Child Speech
|
|
|
|
BASE
|
|
Show details
|
|
12 |
Mathematics for Portuguese students with hearing impairment: an exploratory study of mathematical terms/concepts used in inclusive schools
|
|
|
|
BASE
|
|
Show details
|
|
13 |
Attitudes toward Language Variation: Evidence from a Qualitative Study of Sociolinguistic Interviews
|
|
|
|
BASE
|
|
Show details
|
|
14 |
Sound Discrimination and Explicit Mapping of Sounds to Meanings in Preschoolers with and Without Developmental Language Disorder
|
|
|
|
In: Speech and Hearing Sciences Faculty Publications and Presentations (2020)
|
|
BASE
|
|
Show details
|
|
15 |
Listening in Noise Remains a Significant Challenge for Cochlear Implant Users: Evidence from Early Deafened and Those with Progressive Hearing Loss Compared to Peers with Normal Hearing
|
|
|
|
In: Journal of Clinical Medicine ; Volume 9 ; Issue 5 (2020)
|
|
BASE
|
|
Show details
|
|
16 |
Designing Internet of Tangible Things for Children with Hearing Impairment
|
|
|
|
In: Information ; Volume 11 ; Issue 2 (2020)
|
|
BASE
|
|
Show details
|
|
17 |
Isolation and aspiration: Deaf adults reflect on the educational legacy of special schooling
|
|
Anglin-Jaffe, H. - : Wiley for British Educational Research Association (BERA), 2020
|
|
BASE
|
|
Show details
|
|
18 |
PROSPECTS FOR THE DEVELOPMENT OF A SPECIAL SCHOOL (ON THE MATERIALS OF DISCUSSION WITH TEACHERS) ; ПЕРСПЕКТИВИ РОЗВИТКУ СПЕЦІАЛЬНОГО ЗАКЛАДУ ОСВІТИ (ЗА МАТЕРІАЛАМИ ОБГОВОРЕННЯ ІЗ ПЕДАГОГАМИ)
|
|
|
|
In: Збірник наукових праць Уманського державного педагогічного університету; № 4 (2020); 136-143 ; Collection of Scientific Papers of Uman State Pedagogical University; No. 4 (2020); 136-143 ; 2307-4906 (2020)
|
|
BASE
|
|
Show details
|
|
19 |
Herausforderung (Einzel-)Integration für Menschen mit Hörbehinderung
|
|
|
|
BASE
|
|
Show details
|
|
20 |
Challenges faced by students with hearing impairment: Who use Portuguese Sign Language in mathematics classes
|
|
|
|
BASE
|
|
Show details
|
|
|
|