لطفا منتظر بمانید ...
0% Complete
صفحه اصلی
/
بیست و نهمین کنفرانس مهندسی برق ایران
Bilabial Consonants Recognition in CV Persian Syllable Based on Computer Vision
نویسندگان :
Melika Khajeh
1
Azam Bastanfard
2
Dariush Amirkhani
3
1- دانشگاه آزاد اسلامی واحد کرج
2- دانشگاه آزاد اسلامی واحد کرج
3- دانشگاه صداوسیما
کلمات کلیدی :
CLM algorithm, DTW algorithm, viseme, Consonant, feature extraction, Euclidean distance.
چکیده :
According to previous researches, Persian consonants have been divided into seven categories based on viseme. It led to several consonants being placed in one category. Detecting between consonants in one category is so hard because the spots for the production of these consonants are the same.The forms of lips do not change at the time of production; these consonants are hardly distinguishable. The major challenge is to recognize the differences between lip shapes in one category. The purpose of this study is to recognize differences between bilabial consonants such as /p/, /b/, and /m/ in a word that composed of consonant/vowel called CV by computer vision. For the first time, this study attempts to distinguish these consonants. Proper pronunciations of words are required to identify consonants. Therefore, a database has formed based on the videos of the speech therapists. Generally, this kind of process is including 1- lip detection, 2- lip feature extraction, and 3- classification systems for the diagnosis of consonants. In this paper, consonants recognition in a category based on lip shape using the CLM algorithm for lip detection is presented. Geometric algorithms for feature extraction and DTW and equalizer as a classification system are proposed. Although this study is open because we could identify differences among consonants in just one class, we could reach remarkable CV video results for the first time. We could aim for acceptable results with reasonable accuracy for bilabial consonants detection. The principle purpose of this study is to improve lip-reading systems in security issues and help hearing-impaired people in interaction with their surroundings. The results of this paper can have a positive effect on speech systems.
لیست مقالات
لیست مقالات بایگانی شده
Proposing Multiple Methods for End-Systole and End-Diastole Detection from Echocardiography Videos
Roshanak Ghorbani - Hamid Behnam - Ali Hossein Sabet
A Satellite Tracking Monopulse Antenna Based on Modulated Impedance Surfaces
Amin Azimi - Mohammad Amin Chaychi Zadeh - Efat Nematpour - Amrollah Amini - Vahid Nayyeri
بهینه سازی استفاده از منابع شبکه های نوری با گرومینگ ترافیک در لایهی MPLS
محمدعلی سالک قادری - آرش رضایی - لطف اله بیگی
A Novel Supervisor Framework Toward Optimizing User Quality of Experience for Video Streaming in Software-Defined Networks
Nafiseh Fareghzadeh - Mahdi Bazargani - Sasan H. Alizadeh - Hasan Ziafat
A New Data Delivery Approach for Blockchain based on NDN
Shah Jahan Sirat - Sadegh Dorri Nogoorani - Behzad Akbari
A Time-Distributed Convolutional Long Short-Term Memory for Hand Gesture Recognition
Mehdi Fatan Serj - Mersad Asgari - Bahram Lavi - Domenec Puig Valls - Miguel Angel Garcia
Innovative MOEMS Biosensor for Hepatitis DNA Detection Utilizing an Optical Ring Resonator
Hossein Bahramian - Arash Yazdanpanah Goharrizi
Guided Training of Spiking Neural Networks via an Auxiliary Artificial Neural Network
Neda Falah - Majid Shalchian
A Reconfigurable Dual-Band Aperture-Coupled Magneto-Electric Dipole Antenna Using Dual-Height Electric Dipoles
Fatemeh Kazemi - Changiz Ghobadi - Javad Nourinia - Saeed Hosseini - Mojtaba Amani - Majid Shokri
Optimized ANFIS-based Control Design Using Genetic Algorithm to Obtain the Vaccination and Isolation Rates for the COVID-19
Zohreh Abbasi - Mohsen Shafieirad - Amir Hossein Amiri Mehra - Iman Zamani
بیشتر
ثمین همایش، سامانه مدیریت کنفرانس ها و جشنواره ها - نگارش 44.7.2