کنفرانس مهندسی برق ایران

صفحه اصلی / بیست و نهمین کنفرانس مهندسی برق ایران

Bilabial Consonants Recognition in CV Persian Syllable Based on Computer Vision

نویسندگان :

Melika Khajeh¹ Azam Bastanfard² Dariush Amirkhani³

1- دانشگاه آزاد اسلامی واحد کرج 2- دانشگاه آزاد اسلامی واحد کرج 3- دانشگاه صداوسیما

کلمات کلیدی :

CLM algorithm, DTW algorithm, viseme, Consonant, feature extraction, Euclidean distance.

چکیده :

According to previous researches, Persian consonants have been divided into seven categories based on viseme. It led to several consonants being placed in one category. Detecting between consonants in one category is so hard because the spots for the production of these consonants are the same.The forms of lips do not change at the time of production; these consonants are hardly distinguishable. The major challenge is to recognize the differences between lip shapes in one category. The purpose of this study is to recognize differences between bilabial consonants such as /p/, /b/, and /m/ in a word that composed of consonant/vowel called CV by computer vision. For the first time, this study attempts to distinguish these consonants. Proper pronunciations of words are required to identify consonants. Therefore, a database has formed based on the videos of the speech therapists. Generally, this kind of process is including 1- lip detection, 2- lip feature extraction, and 3- classification systems for the diagnosis of consonants. In this paper, consonants recognition in a category based on lip shape using the CLM algorithm for lip detection is presented. Geometric algorithms for feature extraction and DTW and equalizer as a classification system are proposed. Although this study is open because we could identify differences among consonants in just one class, we could reach remarkable CV video results for the first time. We could aim for acceptable results with reasonable accuracy for bilabial consonants detection. The principle purpose of this study is to improve lip-reading systems in security issues and help hearing-impaired people in interaction with their surroundings. The results of this paper can have a positive effect on speech systems.

لیست مقالات

لیست مقالات بایگانی شده

Investigating the Effects of Adding Distributed Generation Resources to the Distribution Networks on their Protection System Performance

Morteza Abbasghorbani - Elham Vahed

راهبرد بهینه خرده فروش در شبکه توزیع برق با در نظر گرفتن اثر پاسخ گویی بار

امیرحسین مدبری فر - حبیب رجبی مشهدی

طبقه‌بندی خطاهای ترانسفورماتورهای قدرت توسط روش خوشه‌بندی K-means با استفاده از آنالیز گازهای محلول در روغن

ناصر کیانی مهر - حامد زین الدینی میمند

High-Resolution Remote Sensing Image Captioning Based on Structured Attention and SAM Network

Yassin Riyazi - Seyyed Mostafa Sadjadi - Abbas Zohrevand - Reshad Hosseini

Design of an Optical Current Transformer for High-Voltage Gas-Insulated Switchgear-Part II: Focus on GIS Compartment Design

Reza Babaei - Asghar Akbari - Arash Moradi

Guided Training of Spiking Neural Networks via an Auxiliary Artificial Neural Network

Neda Falah - Majid Shalchian

Design and fabrication of a microstrip phase shifter based on liquid crystal

Sadegh Rajabi Doulataabadi - Seyed Hossein Hosseini Biuki - Farid Khoshkhati - Seyed Abbas Jazayeri Moghadas - Mohammad Masoudi Mohammadi - Mehdi Ahmadi-Boroujeni

Numerical investigation of gain switching in Fano semiconductor lasers

Arash Hodaie - Hassan Kaatuzian - Aref Rasoulzadeh Zali

Solving the inverse problem for EEG signals when learning a new motor task using GRU neural network

Milad Khosravi - Fariba Bahrami - Behzad Moshiri - Ahmad Kalhor

Investigation of Li3P as Electrolyte and Lithium-ion conductor: An Ab-Initio Study

Keyvan Khosh Abady - ََamin Niksirat - Negar Karpourazar - Mahdi Pourfath

بیشتر