Spaces:
Running
Running
SLM Parameter Count Limits
#1
by wayneworkman2012 - opened
Hello, I like that you built this. It allows people to use smaller models more easily. Though generally most SLM arenas and leaderboards only consider 150M parameters and smaller. Calling a 1B an SLM skews what the community considers to be small.
Hi,
Sorry to hear that, but, "small" in SLM doestn mane 150M and smaller. The term of SLM doesnt have a actual limit of what counts as one. So while for me anything under 3B is a SLM for you it might be anything under 150M or lower.
The general size limit for a SLM is relative, but is usually 14B max, not just 150M.