0% Complete
صفحه اصلی
/
بیست و نهمین کنفرانس مهندسی برق ایران
Bilabial Consonants Recognition in CV Persian Syllable Based on Computer Vision
نویسندگان :
Melika Khajeh
1
Azam Bastanfard
2
Dariush Amirkhani
3
1- دانشگاه آزاد اسلامی واحد کرج
2- دانشگاه آزاد اسلامی واحد کرج
3- دانشگاه صداوسیما
کلمات کلیدی :
CLM algorithm, DTW algorithm, viseme, Consonant, feature extraction, Euclidean distance.
چکیده :
According to previous researches, Persian consonants have been divided into seven categories based on viseme. It led to several consonants being placed in one category. Detecting between consonants in one category is so hard because the spots for the production of these consonants are the same.The forms of lips do not change at the time of production; these consonants are hardly distinguishable. The major challenge is to recognize the differences between lip shapes in one category. The purpose of this study is to recognize differences between bilabial consonants such as /p/, /b/, and /m/ in a word that composed of consonant/vowel called CV by computer vision. For the first time, this study attempts to distinguish these consonants. Proper pronunciations of words are required to identify consonants. Therefore, a database has formed based on the videos of the speech therapists. Generally, this kind of process is including 1- lip detection, 2- lip feature extraction, and 3- classification systems for the diagnosis of consonants. In this paper, consonants recognition in a category based on lip shape using the CLM algorithm for lip detection is presented. Geometric algorithms for feature extraction and DTW and equalizer as a classification system are proposed. Although this study is open because we could identify differences among consonants in just one class, we could reach remarkable CV video results for the first time. We could aim for acceptable results with reasonable accuracy for bilabial consonants detection. The principle purpose of this study is to improve lip-reading systems in security issues and help hearing-impaired people in interaction with their surroundings. The results of this paper can have a positive effect on speech systems.
لیست مقالات
لیست مقالات بایگانی شده
Fragmentation-aware Coordinated Virtual Optical Network Embedding Algorithm Over Elastic Optical Networks
Niusha Sabri Kadijani - Lotfollah Beygi
کنترل وضعیت ماهواره با کنترل پیشبین اقتصادی مقاوم مبتنی بر تیوب با محاسبات کاهش یافته
مهیار مدنی اصفهانی - عارف آقاملائی - طالب عبدالهی - سعید شمقدری
External Force Control with Disturbance Rejection for 6 DoF Manipulator
Zahra Bonakdar - Arefe Hamidipour - Hamed Ghafarirad
Image denoising using convolutional neural network
Behnam Latifi - Abolghasem Raie
3D Microwave Imaging inside PEMC Cavity Using Combined-Norm Regularization Term and Modified CG Algorithm
Omid Babazadeh - Hassan Nasseri
Effective Rate Analysis of MISO Wireless Communication Systems over EGK Fading Channels
ّfereshteh Salimian Rizi - Abolfazl Falahati
پیشبینی بلندمدت بار فصلی شبکه برق با استفاده از روش سری زمانی ETS
میلاد حاجی ابوالحسنی - محسن صفرزاده - زهرا عظیمی - سیدمرتضی میرباقری
RSF: Reinforcement learning based hybrid split and federated learning for edge computing environments
Alireza Soleimani - Negar Anabestani - Mahmoud Momtazpour
Ground-based Power Line Sag Measurement by Combining Data from a Smartphone and a Laser Rangefinder
Mohammad Javad Abdollahifard - Reza Bahrami
همزمان سازی سمبلها در مخابرات مولکولی مبتنی بر انتشار
سمانه منطقی - علی جمشیدی
ثمین همایش، سامانه مدیریت کنفرانس ها و جشنواره ها - نگارش 40.4.2