کنفرانس مهندسی برق ایران

صفحه اصلی / سی و دومین کنفرانس بین المللی مهندسی برق

Mapping Human Grasping to 3-Finger Grippers: A Deep Learning Perspective

نویسندگان :

Fatemeh Naeinian¹ Elnaz Balazadeh² Mehdi Tale Masouleh³

1- University of Tehran 2- University of Tehran 3- University of Tehran

کلمات کلیدی :

Grasping،Grasp Detection،MediaPipe،Deep Learning،Object Detection

چکیده :

Grasping is a fundamental aspect of human interaction with the environment, and replicating this ability in robotic systems is challenging due to the complexity of hand-object interactions. This paper explores the mapping of human grasping behavior to a 3-finger robotic gripper using a deep learning approach. The study focuses on the development of a model that predicts grasping points based on RGB images of objects and finger coordinates during the approaching state. The research contributes a novel dataset of human-like grasping with 3 fingers, capturing various object orientations and scenarios. Finger coordinates are extracted in both the approaching and grasping states by using Mediapipe. The proposed model employs a pre-trained Faster R-CNN for object detection, coupled with fully connected networks for regression of grasping points. Evaluation metrics include Intersection over Union (IoU), grasp angle, and accuracy of predicted points for each finger. The trained network achieves compelling results, demonstrating 72% accuracy, 96.5% in grasp angle, and a 30% IoU in grasp rectangle representation. Results indicate the efficacy of the approach, offering a promising avenue for advancing robotic grasping capabilities.

لیست مقالات

لیست مقالات بایگانی شده

Control of a Wheeled Robot in the Presence of Wheels Sliding Using Robust Adaptive Control in Differential Game Format

Alireza Azimi - Roya Amjadifard - Aliakbar Ghasemzadeh

A Single-Fed Circularly-Polarized Elliptical Slot Antenna for S-Band applications

Sina Rezaee - Mahdi Janforooz - Behnam Rasoulpour

Bit Error Mitigation Using Unequal Resistivity Levels in Memristors

Amir Mohammad Hajisadeghi - Peiman Pourmomen - Hamid Reza Zarandi

پایش و مانیتورینگ آنلاین ترانسفورماتورهای قدرت با طراحی سامانه مه ست مدلی جدید جهت بهره مندی از کاهش خسارت و تلفات غیر فنی ترانس

حمید رونق - محمد رضا آریانپور - منصور اکبری - ناصر امینایی - سید اکبر میرنیام

ساخت حسگر گاز بر پایه ی گرافن اکساید و سیلیکون متخلخل

سیده صفیه رضایی - مینا امیر مزلقانی

Robust Neuro-Adaptive Fuzzy Sliding Mode Control for a Remotely Operated Underwater Vehicle Manipulator

Mahdi Armoon - Marzie Lafouti - Babak Tavassoli - Hamid D. Taghirad

An Energy Compensation Approach to Variable Stiffness Single Leg Jumping

Mohammadreza Gilak - Mehdi Zarei - Mohammad Hossein Basiri - Saman Samiei - Mohammad Mehdi Jalalmaab - Behzad Ahi

User Management in Cell-Free Massive MIMO Systems with Limited Fronthaul Capacity

Siminfar Samakoush Galougah - Hamed Masoumi - Mohammad Javad Emadi

Modeling the Cable Bridge Based on Two Dimensional System and Analysing the Stability of Desired Model Based on Wave Advanced Model

Mehdi Mirshahi - Masoud Shafiee - Mehdi Mohammadi

Automated Optic Disc Segmentation in Low-Quality Retinopathy of Prematurity Retinal Images

Abolfazl Karimiyan Abdar - Reza AghaeiZadeh Zoroofi - Naser Shoeibi - Sare Safi - Alireza Ramezani - Homayoun Nikkhah - Hamid Safi - Mohammad Reza Ansari Astaneh

بیشتر