Hugging Face's logo
Abhilash Nandy's picture
8 1

Abhilash Nandy

abhi1nandy2
pcuenq's profile picture itsbrex's profile picture John6666's profile picture
·
https://sites.google.com/view/abhilashnandy/home

AI & ML interests

Natural Language Processing, Computer Vision

Recent Activity

upvoted a paper about 2 months ago
Leveraging Self-Attention for Input-Dependent Soft Prompting in LLMs
posted an update about 2 months ago
A New Update! Paper "Leveraging Self-Attention for Input-Dependent Soft Prompting in LLMs" accepted at ACL 2025 (Main) Conference HuggingFace Paper Link - https://huggingface.co/papers/2506.05629 Authors - Ananth Muppidi, Abhilash Nandy, Sambaran Bandyopadhyay Abstract - The performance of large language models in domain-specific tasks necessitates fine-tuning, which is computationally expensive and technically challenging. This paper focuses on parameter-efficient fine-tuning using soft prompting, a promising approach that adapts pre-trained models to downstream tasks by learning a small set of parameters. We propose a novel Input Dependent Soft Prompting technique with a self-Attention Mechanism (ID-SPAM) that generates soft prompts based on the input tokens and attends different tokens with varying importance. Our method is simple and efficient, keeping the number of trainable parameters small. We show the merits of the proposed approach compared to state-of-the-art techniques on various tasks and show the improved zero shot domain transfer capability.
commented on a paper about 2 months ago
Leveraging Self-Attention for Input-Dependent Soft Prompting in LLMs
View all activity

Organizations

None yet