piratespartyforallsoftwareopensource (Pirates Party for all software open source)

posted an update 4 days ago

Post

2763

SPECK 2 IS ALREADY OUT: specklabs/Speck2-140M

Pretrained on 4x more tokens than the previous releases (20b vs 5b).
Instruct tuned versions are coming soon.
Very interesting models are coming soon too (hint: super long context).

Thanks for everyone supporting!

2 replies

·

AtAndDev

posted an update 6 days ago

Post

148

SPECK1.5 IS COMING SOON!
Same 5B token budget but much better corpus quality.

Also getting a ton of downloads, thanks for everyone downloading and liking <3

specklabs

AtAndDev

posted an update 9 days ago

Post

138

NEW SPECK UPDATES:

Just hit #14 and #15 with out FIRST models on Open SLM Leaderboard. The models were trained on 5B tokens, while competing with similarly sized models trained on more than 6-20x the data.

A new base model Speck1.5-140M being trained right now on a higher quality corpus and will be released soon.
SpeckChat3 is coming very soon with 1 million samples, specifically designed to post train small base models.

Also, just to clarify stuff, we will NOT release anything that is NOT MIT licensed EVER. Openness is needed in small language research.

Thanks to everyone supporting the project, and stay tuned for new releases!

AtAndDev

posted an update 10 days ago

Post

1876

SPECK UPDATES:
1 New instruct model tuned on top of Speck1-140M: specklabs/Speck1-140M-Instruct
2 Instruction tuning datasets
2 GGUFs

Much more coming soon:
Speck1.1-140M-Instruct that is post trained on SpeckChat2 will be coming very soon
New base model Speck1.5-140M is coming with a much higher quality corpus

Thanks to everyone who is already supporting the project, and stay tuned for new releases!

3 replies

·

AtAndDev

posted an update 12 days ago

Post

2116

FIRST SPECK MODEL RELEASED:
specklabs/Speck1-140M

new models coming very soon (both instruct and much better models), with much much higher training scale as i am getting marenostrum5 access soon!
we will be looking at 100b-2t token budgets :)

4 replies

·

Goekdeniz-Guelmez

submitted a paper to Daily Papers 6 months ago

DynaMoE: Dynamic Token-Level Expert Activation with Layer-Wise Adaptive Capacity for Mixture-of-Experts Neural Networks

Paper • 2603.01697 • Published Mar 2 • 2

Goekdeniz-Guelmez

authored a paper 6 months ago

DynaMoE: Dynamic Token-Level Expert Activation with Layer-Wise Adaptive Capacity for Mixture-of-Experts Neural Networks

Paper • 2603.01697 • Published Mar 2 • 2

Goekdeniz-Guelmez

authored a paper 8 months ago

Gabliteration: Adaptive Multi-Directional Neural Weight Modification for Selective Behavioral Alteration in Large Language Models

Paper • 2512.18901 • Published Dec 21, 2025 • 6

AtAndDev

posted an update about 1 year ago

Post

782

Qwen 3 Coder is a personal attack to k2, and I love it.
It achieves near SOTA on LCB while not having reasoning.
Finally people are understanding that reasoning isnt necessary for high benches...

Qwen ftw!

DECENTRALIZE DECENTRALIZE DECENTRALIZE

AtAndDev

posted an update over 1 year ago

Post

3255

deepseek-ai/DeepSeek-R1-0528

This is the end

2 replies

·

21world

updated a collection over 1 year ago

sd model

Collection

3 items • Updated May 15, 2025

AtAndDev

posted an update over 1 year ago

Post

3160

Llama 4 is out...

3 replies

·

21world

updated a collection over 1 year ago

sd model

Collection

3 items • Updated May 15, 2025

AtAndDev

posted an update over 1 year ago

Post

4397

There seems to multiple paid apps shared here that are based on models on hf, but some ppl sell their wrappers as "products" and promote them here. For a long time, hf was the best and only platform to do oss model stuff but with the recent AI website builders anyone can create a product (really crappy ones btw) and try to sell it with no contribution to oss stuff. Please dont do this, or try finetuning the models you use...
Sorry for filling yall feed with this bs but yk...