Instructions to use hollywang/wangxf.holly-Qwen-7B-LoRA_demo with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use hollywang/wangxf.holly-Qwen-7B-LoRA_demo with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("Qwen-7B-Chat") model = PeftModel.from_pretrained(base_model, "hollywang/wangxf.holly-Qwen-7B-LoRA_demo") - Notebooks
- Google Colab
- Kaggle
wangxf.holly-Qwen-7B-LoRA_demo
模型介绍
这是一个基于 Qwen-7B-Chat 进行微调(LoRA)的对话模型。
该模型由个人/团队使用 QLoRA 技术微调而成,保留了 Qwen 模型强大的中文理解与生成能力,并注入了特定领域/任务的知识。
模型详情
- 基础模型:Qwen/Qwen-7B-Chat
- 微调框架:PEFT (LoRA)
- 任务类型:通用对话/文本生成
- 模型大小:70 亿参数(LoRA 适配器仅几 MB)
- 许可证:Apache 2.0
使用方法
1. 环境配置
确保已安装依赖库:
pip install torch transformers peft accelerate sentencepiece
- Downloads last month
- -
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for hollywang/wangxf.holly-Qwen-7B-LoRA_demo
Base model
Qwen/Qwen-7B-Chat