لطفا منتظر بمانید ...
0% Complete
صفحه اصلی
/
سی و چهارمین کنفرانس بین المللی مهندسی برق
Efficient Large Language Models with Zero-Shot Adjustable Acceleration
نویسندگان :
Sajjad Kachuee
1
Mohammad Sharifkhani
2
1- دانشگاه صنعتی شریف
2- دانشگاه صنعتی شریف
کلمات کلیدی :
Zero-Shot Adjustable Acceleration،Preservation Rate،Hidden Activation،Context Contribution
چکیده :
Large Language Models (LLMs) face significant challenges in real-world applications, particularly in balancing computational efficiency and model performance. Acceleration during both fine-tuning and inference is essential for designing efficient architectures. This paper presents a novel training and inference method, termed zero-shot adjustable acceleration, which dynamically adjusts hardware utilization at inference time without additional fine-tuning. The method is applied to recent LLMs and evaluated on multiple classification and text generation benchmarks. Experimental results demonstrate that the approach enables flexible zero-shot acceleration and achieves up to an 11× speedup over baseline methods, while maintaining high model performance.
لیست مقالات
لیست مقالات بایگانی شده
A Novel Unknown Input Observer Synthesis for 2-D Discrete-Time Varying Delay Systems under Simultaneous Disturbances: FM-II Model
Mehdi Mirshahi - Masoud Shafiee
Image denoising using convolutional neural network
Behnam Latifi - Abolghasem Raie
Automotive radar target classification using NMF-decomposed micro-Doppler signatures
Amin Aghatabar Roodbary - Sara Changizi - Mohammad Hassan Bastani - Fereidoon Behnia
Analysis and Simulation of the Formation and dimensions of Gate-Defined Double Quantum Dots
Mahya Mostafavi - Majid Shalchian
Design and Implementation of a Compact 4×4 Microstrip Patch Antenna Array with Circular Polarization for Nano Satellite Applications
Mohammad Ghasemi - Majid Afsahi - Shoresh Namdari
DWT-Based Epileptic Seizure Detection Using Fuzzy Logic Model with Entropy and Table Lookup Scheme
Alireza Mohammadi - Arvin Esfandyari - Ali Doustmohammadi - Amir Abolfazl Suratgar - Masoud Shafiee
High-Performance Biosensor Based on SRR for Early Breast Cancer Detection
Hasti Enayattarighehkari - Sina Aramtan - Gholamreza Moradi - Farhad Azadi Namin
Electronic properties of 2D perovskites NMA2PbBr4 and NEA2PbBr4 for PeLED applications: first principle approach
Samad Shokouhi - Seyedeh bita Saadatmand - Vahid Ahmadi
Monitoring of Respiration Rate and Heart Rate Using a FMCW Millimeter Wave Radar
Elahe Nazarian - Mohammad Saeed Majedi - Amir Reza Attari
طراحی و تحلیل یک حسگر پلاسمونیک ضریب شکست بر پایه فیبر بلور فتونی با هدف بهبود مشخصات فنی
علی یاوری - حسن کاتوزیان - سارا قلی نژاد شفق
بیشتر
ثمین همایش، سامانه مدیریت کنفرانس ها و جشنواره ها - نگارش 44.7.2
