metadata
library_name: transformers
tags:
- From_Scratch
- Custom
- YSNRFD
- SLM
- ysnrfd
- Persian_SLM
datasets:
- ysn-rfd/fibonacci_alpaca_to_sharegpt_gpt_format_convert_new_dataset_release
language:
- fa
Model Details
WARNINNGS: This Model IS Pre-Trained, in the future will be finetuned.
Model Description
The First Persian SLM By YSNRFD, This Model support Only Persian text Inputs, In The Future I Want Add Englih Language Support.
- Developed by: ysnrfd
- Funded by [optional]: ysnrfd
- Shared by [optional]: ysnrfd
- Model type: SLM
- Language(s) (NLP): Persian
- License: ysnrfd LICENSE
Training Data
ysnrfd Sample Persian Text LINK: https://huggingface.co/datasets/ysn-rfd/fibonacci_alpaca_to_sharegpt_gpt_format_convert_new_dataset_release
Training Hyperparameters
- Training regime: fp16 mixed precision
Evaluation
Not Yet
Testing Data, Factors & Metrics
ysnrfd Sample Persian Text
Testing Data
Not Yet
Summary
The Fisrt Persian SLM Trained From Scratch
- Hardware Type: Nvidia Tesla T4 (1)
- Hours used: 4H
- Cloud Provider: Google Colab
Model Architecture and Objective
YSNRFD Architecture
Hardware
Nvidia Tesla T4
Software
Python Code, From Scratch, Pytorch