That's a sweetspot no one had exploited yet, more powerful than 0.5b-0.6b parameters yet smaller than 0.8-1b parameters.
Given that No Size is Left Behind, I guess yes?
· Sign up or log in to comment
