AI & ML interests

None defined yet.

Recent Activity

Felladrin  updated a model about 17 hours ago
onnx-community/whisper-kannada-base-ONNX
Felladrin  published a model about 17 hours ago
onnx-community/whisper-kannada-base-ONNX
Xenova  updated a model 1 day ago
onnx-community/s1-mini-ONNX
View all activity

Felladrin 
posted an update 3 days ago
view post
Post
4028
I've open-sourced the trainer I've been using to build tiny language models from scratch, together with the 95M base model I trained with it.

The trainer runs on Deno (https://deno.com, cross-platform), trains on WebGPU, and it writes GGUF directly. No Python/PyTorch. The weights live in a GGUF file from the first step to the last, so every checkpoint is already something llama.cpp can load.

The model is Felladrin/Minueza-3-95M-Base: 94.7M parameters, 1.95B tokens seen, 8192 context.

And here’s the repository on GitHub: https://github.com/felladrin/gguf-trainer

Here on Hugging Face, I published the optimizer state next to the weights, so you can continue the pretraining instead of starting over.

Or start your own from nothing: deno run -A cli.ts demo trains a tiny one end to end in under a minute.

And the docs are written for coding agents, so you can point your agent of choice at the GitHub repo and have it drive the whole pipeline.
  • 36 replies
·
Nymbo 
posted an update 10 days ago
view post
Post
1944
Anthropic gave me six months of Claude Max 20x through the Claude for Open Source program, granted based on my Hugging Face work. Thank you
Anthropic
for supporting open source.

So far I've been pointing it at Markdown Minimap, an Obsidian plugin that adds a scrollable IDE-style minimap to your notes. This week I've been clearing a backlog of user-reported issues on it, with Claude often handling them end to end.

https://github.com/Nymbo/Markdown-Minimap — issues and PRs welcome.