Hugging Face's logo
SeanLee's picture
57 18 135

SeanLee

SeanLee97
islameissa's profile picture SridharGrapheme's profile picture bradex's profile picture
·

AI & ML interests

NLP; Information Retrieval; Information Extraction

Recent Activity

liked a model about 16 hours ago
TencentARC/ARC-Hunyuan-Video-7B
liked a model 11 days ago
tencent/HY-Embodied-0.5
reacted to theirpost with 😎 11 days ago
Our lab recently released a paper where we introduce ShadowPEFT, a new Parameter-Efficient Fine-Tuning (PEFT) paradigm tailored for edge computing scenarios. Unlike traditional approaches such as LoRA and its variants, which inject trainable parameters directly into the weights of Transformer, requiring tight coupling with the backbone. ShadowPEFT instead enhances the frozen large base model by adding a lightweight, centralized, pretrainable, and detachable Shadow network. This shadow network operates in parallel with the base model, delivering learned corrections to each decoder layer. Because the shadow module is architecturally decoupled from the backbone, it can be independently trained, stored, and deployed, benefiting edge computing scenarios and edge-cloud collaboration computing. - HF Paper: https://huggingface.co/papers/2604.19254 - GitHub: https://github.com/ShadowLLM/shadow-peft - HF Collection: https://huggingface.co/collections/shadow-llm/shadow-peft-models
View all activity

Organizations

The Hong Kong Polytechnic University's profile picture WhereIsAI's profile picture Mixedbread's profile picture openbread's profile picture hessian-t's profile picture