TinyNews
Collection
TinyNews is a collection of one million synthetically generated news bulletins and several small language models scratch-trained on this data • 5 items • Updated
Tiny News
For a detailed overview of this project from start to finish, check out GregSamek.github.io/TinyNews
TinyNews is a collection of one million synthetically generated news bulletins and several language models scratch-trained on this data. Evaluations suggests that TinyNews retains ~80% of the quality of the training data while using ~1/1000th the number of parameters as the models used to generate it.
To run these models, git clone the repository
Trained models and training data are available in this 🤗 Hugging Face Collection
This project is essentially a modified reimplementation of the Microsoft Research TinyStories project.
- Downloads last month
- 4
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support