کنفرانس مهندسی برق ایران

صفحه اصلی / سی و چهارمین کنفرانس بین المللی مهندسی برق

Towards Better Domain Generalization with Jacobian Norm Regularization

نویسندگان :

Abolfazl Ettehadieh¹ Mostafa Tavassolipour² Hamid Soltanian-Zadeh³

1- دانشگاه تهران، دانشکده مهندسی برق و کامپیوتر 2- دانشگاه تهران، دانشکده مهندسی برق و کامپیوتر 3- دانشگاه تهران، دانشکده مهندسی برق و کامپیوتر

کلمات کلیدی :

Domain Generalization،Jacobian Regularization،Flat Minima،Robustness

چکیده :

Domain generalization (DG) aims to train models that perform well on unseen target domains despite distributional shifts from the source domains. In this work, we propose a regularization approach based on estimating the Jacobian norm to improve model generalization by reducing sensitivity to input variations. Prior studies have demonstrated that the Jacobian norm correlates with generalization performance, as it measures model sensitivity to perturbations, and that it is linked to flatter minima on the loss landscape. Building on these insights, we approximate the Frobenius norm of the Jacobian using the Hutchinson trace estimator to avoid high computational costs and incorporate it as a penalty term in the empirical risk minimization (ERM) loss; we further combine this method with SWAD,anensemble technique that promotes flat minima through weight averaging, to enhance its effectiveness. We evaluate our approach using the DomainBed protocol on four benchmark datasets: VLCS, PACS, Office-Home, and TerraIncognita. Results show consistent improvements over the ERM baseline, such as a 1.5% increase in mean accuracy on VLCS (reaching 79.0%). Additionally, visualizations of attention maps indicate that our method extracts more domain-invariant features, focusing on category-related elements rather than backgrounds. Overall, this Jacobian-based regularization offers a simple yet effective way to boost DG, supported by its connections to robustness and generalization from previous research. Source code is available at https://github.com/Ettehadieh/JR DG

لیست مقالات

لیست مقالات بایگانی شده

Enhancing the Performance of Piezoelectric Sensors Using RTV2 Elastomer Coatings

Amirreza Kamali - Amirhossein Jafari - Ehsan Maani Miandoab

Techno-Economic Planning of Vehicle-to-Grid enabled Charging Stations in Renewable-Energy Integrated Distribution Networks

Farough Mansournia - Tohid Ghanizadeh Bolandi - Sajjad Golshannavaz - Fardin Hasanzad

Breast tumor detection using graphene-based terahertz patch antenna

Zahra Yasaghi - Ayaz Ghorbani - Gholamreza Moradi

Finite-time consensus of multi-agent systems via event-triggered control

Mehdi Zamanian - Farzaneh Abdollahi - Seyyed Kamaleddin Yadavar Nikravesh

Temporal Evolution Near Exceptional Points of Degeneracy in Lossless and Lossy LC Resonators with A Sinusoidally Modulated Capacitance

Pegah Babarahmatian - Mohammad Memarian - Khashayar Mehrany

A model to measure cyber security maturity at the national level

Mahdi Omrani - Masoud Shafiee - Siavash Khorsandi

An incentive compatible reward sharing approach for shard-based blockchains

Mojdeh Hemati - Mehdi Shajari

Non-contact Radar Technology and Machine Learning for Automated Sleep Apnea-Hypopnea Syndrome Detection

ُSaman Faridsoltani - Mohaddeseh Sadeghi - Zahra Rahmani - Somayyeh Chamaani

Design and fabrication of a microstrip phase shifter based on liquid crystal

Sadegh Rajabi Doulataabadi - Seyed Hossein Hosseini Biuki - Farid Khoshkhati - Seyed Abbas Jazayeri Moghadas - Mohammad Masoudi Mohammadi - Mehdi Ahmadi-Boroujeni

Techno-Economic Dispatch of Distributed Energy Resources for Optimal Grid-Connected Operation of a Microgrid

Selma Cheshmeh khavar - Arya Abdolahi

بیشتر