کنفرانس مهندسی برق ایران

صفحه اصلی / سی و یکمین کنفرانس بین المللی مهندسی برق

Transformer-Based Unsupervised Image Registration using SSIM and Homography Loss for Steady Camera and Aerial Videos

نویسندگان :

Golnoosh Abdollahinejad¹ Matin Hashemi²

1- دانشگاه صنعتی شریف 2- دانشگاه صنعتی شریف

کلمات کلیدی :

Computer Vision،Image Registration،Transformer Network،Deep Learning

چکیده :

Image registration is an essential and initial block in the pipeline of computer vision tasks and systems. It is defined as the process of transforming a moving image into a target image with minimum difference when get aligned. Unlike previous work for general-purpose datasets, aerial images suffer from mechanical shakes which leads to deformed distortion that is similar to medical volumetric image registration task. Inspired by medical approaches, we use a Transformer-based network to have a semi-unlimited receptive field Swin block, to produce a general output for each pixel named flow matrix. Flow matrix is utilized instead of regressing parameters of transformation matrix with a fixed degree of freedom that can't handle the structural difference between images. This leads to introducing of a new loss function based on the Structural Similarity Index Measure (SSIM) and embedding Homography transformation as a regularization term. The combination of a generalized-designed network and loss function based on problem definition significantly enhanced results.

لیست مقالات

لیست مقالات بایگانی شده

Power Consumption and I/Q-to-Phase Analysis in Direct Demodulation Approaches

Mir mahdi Safari - Jafar Pourrostam

Contrastive Learning Framework for fMRI Time-Series Classification in Left and Right Epilepsy Using Continues Wavelet Transform

Marzieh Soheili-nejad - Saeed Masoudnia - Hamid Soltanian-zadeh

Spotting of a Particular Printed Word in Farsi Handwritten Forms Using Deep Learning

Mohammad jafar Gholami Kenari - Ehsanollah Kabir

Design and fabrication tip tapered fiber optic dopamine sensor based on LSPR

Roksana Esmaeilpour - Mohammad Ismail zibaii - Masoumeh Barkand - Marzieh Pajouhandeh - Soroush Rostami - Mehdi Banihashemi - Mohammad-Mahdi Babakhani-fard

طراحی کنترل‌کننده‌ی جدول‌بندی بهره‌ی پس‌خورد خروجی کلیدزن مقاوم برای سیستم‌های پارامتر متغیر خطی نامعین چندوجهی پیوسته-زمان

رضا یاوری - سعید شمقدری - آرش صادق‌زاده

Strategic Offering of a Virtual Power Plant in Energy Markets Under Contingency Conditions: A Hybrid Stochastic Robust Optimization Approach

Elahe Ghanaee - Morteza Rahimiyan

A Geometry-based Approach to Reduce the Quantization lobe in 1-bit Reconfigurable Intelligent Surfaces

Nima Ahmadi - Forouhar Farzaneh

Design and fabrication of wearable and stretchable EEG headband using textile-based electrode wire

Kourosh Motiepor - Arman Modoudi Yaghouti - Simin Bakhtiyari - Amir Jahanshahi - Roohollah Bagherzadeh

Refractive Index Sensor Based on Photonic Crystal Nanocavities

Mohammad Zargarzadeh - Mohammad Hasan Yavari - Mohammad Heydari - Mohammad Hasan Rezaei

یک روش جدید در تشخیص اختلال طیف اوتیسم از تصاویر چهره کودکان با استفاده از معماری چندمقیاسی MS-ViT و پردازش لبه‌ای

خسرو رضائی - طیبه شمولی جوانمردی - امیر محمد حیدری

ثمین همایش، سامانه مدیریت کنفرانس ها و جشنواره ها - نگارش 40.4.2