0% Complete
صفحه اصلی
/
بیست و نهمین کنفرانس مهندسی برق ایران
Bilabial Consonants Recognition in CV Persian Syllable Based on Computer Vision
نویسندگان :
Melika Khajeh
1
Azam Bastanfard
2
Dariush Amirkhani
3
1- دانشگاه آزاد اسلامی واحد کرج
2- دانشگاه آزاد اسلامی واحد کرج
3- دانشگاه صداوسیما
کلمات کلیدی :
CLM algorithm, DTW algorithm, viseme, Consonant, feature extraction, Euclidean distance.
چکیده :
According to previous researches, Persian consonants have been divided into seven categories based on viseme. It led to several consonants being placed in one category. Detecting between consonants in one category is so hard because the spots for the production of these consonants are the same.The forms of lips do not change at the time of production; these consonants are hardly distinguishable. The major challenge is to recognize the differences between lip shapes in one category. The purpose of this study is to recognize differences between bilabial consonants such as /p/, /b/, and /m/ in a word that composed of consonant/vowel called CV by computer vision. For the first time, this study attempts to distinguish these consonants. Proper pronunciations of words are required to identify consonants. Therefore, a database has formed based on the videos of the speech therapists. Generally, this kind of process is including 1- lip detection, 2- lip feature extraction, and 3- classification systems for the diagnosis of consonants. In this paper, consonants recognition in a category based on lip shape using the CLM algorithm for lip detection is presented. Geometric algorithms for feature extraction and DTW and equalizer as a classification system are proposed. Although this study is open because we could identify differences among consonants in just one class, we could reach remarkable CV video results for the first time. We could aim for acceptable results with reasonable accuracy for bilabial consonants detection. The principle purpose of this study is to improve lip-reading systems in security issues and help hearing-impaired people in interaction with their surroundings. The results of this paper can have a positive effect on speech systems.
لیست مقالات
لیست مقالات بایگانی شده
Autonomous, Bio-inspired vision-based navigation system for indoor flying using hybrid optical flow and stereopsis methods
Masoud Mohtadifar - Hadi Seyedarabi
Diagnosis of Heart Diseases based on Processing Heart Sound using Machine Learning
Maryam Moulaverdi - Akbar Ranjbar
On spatiotemporal-aware deep neural networks for real-time video fire detection: empowering image-based models with temporal and spatial features of video
Mahdi Shamisavi - Sahar Eslami - Amir Jahanshahi - Morteza Rajabzadeh
Type-2 fuzzy expert system for management of smart home with combining renewable resources
Ali Beheshtikhoo - Mahdi Pourgholi - Iman Khazaee
A Novel HVDC Transmission System Based on Z-Source Converter
Mehdi Zareian Jahromi - Mohammadreza Mousavikhademi - Ebrahim Kazemi
A Multilevel Ac-Ac Converter with Input-series and Output-Parallel as Dynamic Voltage Restorer
Seyed mohsen Mortazavi - Reza Beiranvand
Bit Error Rate Analysis for a Mixed Underwater OWC-FSO Relaying System in the Presence of Pointing Error
Mahdis Saghaee Jahed - Meysam Ghanbari - Seyed Mohammad Sajad Sadough
طراحی و شبیه سازی جاذب شفاف فراماده تک لایه پهن باند مبتنی بر الگوی فرکتالی با پایداری زاویه ای بالا و غیر حساس به قطبش
سحر سوقی - حمید حیدر - محمدرضا هراتی - وحید نیری
Helmet Microwave Array Applicator for Deep-Seated Brain Tumor Hyperthermia
Mohammad Moeini Arani - Mohammad Javad Hajiahmadi - Reza Faraji-Dana
Model Predictive Control for Interconnected Systems with Communication Delays
Reza Mohammadikia - Mahsan Tavakoli-Kakhki
بیشتر
ثمین همایش، سامانه مدیریت کنفرانس ها و جشنواره ها - نگارش 42.0.4