SupraLabs/Supra2-Nano
Text Generation • 800k • Updated • 9
🔄 In a Training Loop
Mr Munk
GODELEV
AI & ML interests
High schooler by day, LLM builder by night. Driven by a deep love for both Physics and AI. Currently spending my runtime building on Hugging Face, experimenting with transformer architectures, and training custom LLMs.
Recent Activity
liked a model about 9 hours ago
SupraLabs/Supra2-Nano new activity about 9 hours ago
GODELEV/Rose-Medium:Leaderboard new activity about 14 hours ago
AxiomicLabs/Open_SLM_Leaderboard:Add Lumen-118M-BaseOrganizations
liked a
model about 9 hours ago
Leaderboard
7
#5 opened 5 days ago
by 
Banaxi-Tech
Add Lumen-118M-Base
25
#83 opened 1 day ago
by 
kefir090
updated a
dataset about 16 hours ago
published a
dataset about 16 hours ago
Hats OFF!!
15
#1 opened about 18 hours ago
by GODELEV
upvoted an article 1 day ago
Article
Extreme Overtraining in Tiny Language Models
Banaxi-Tech
• • 8 liked a
model 2 days ago
replied to LH-Tech-AI's post 2 days ago
Tbh , Tell me you have a "GPU farm" Banaxi , you release model as frequently as we sleep , Every morning i see something new from you side
liked a
model 2 days ago
reacted to LH-Tech-AI's post with 🔥 2 days ago
Post
2083
Hey community and sponsors!
We are announcing the Supra3 family with four core SLM models:
- Supra3 Flash Lite: 25M parameters, ~60B pretraining tokens
- Supra3 Flash: 50M parameters, ~100B pretraining tokens
- Supra3 Pro: 75M parameters, ~150B pretraining tokens
- Supra3 Ultra: 100M parameters, ~200B pretraining tokens
For Supra3 Pro and Ultra, we search for sponsors who give us free access to compute like RTX 5090 32GB or so.
We estimate the total cost of the pro and ultra models at around $600.
For Supra3 Flash Lite and Flash, we do not need sponsors.
If anyone would apply for helping us, we would be really thankful and this person would get early access to new modele, insider information, credit and more!
Contact: here or on discord: lh_tech_ai
We are announcing the Supra3 family with four core SLM models:
- Supra3 Flash Lite: 25M parameters, ~60B pretraining tokens
- Supra3 Flash: 50M parameters, ~100B pretraining tokens
- Supra3 Pro: 75M parameters, ~150B pretraining tokens
- Supra3 Ultra: 100M parameters, ~200B pretraining tokens
For Supra3 Pro and Ultra, we search for sponsors who give us free access to compute like RTX 5090 32GB or so.
We estimate the total cost of the pro and ultra models at around $600.
For Supra3 Flash Lite and Flash, we do not need sponsors.
If anyone would apply for helping us, we would be really thankful and this person would get early access to new modele, insider information, credit and more!
Contact: here or on discord: lh_tech_ai
- 14 replies
replied to LH-Tech-AI's post 2 days ago
Excited for Supra 3
liked a
model 2 days ago
Adding Rose-Medium
👍 1
9
#79 opened 3 days ago
by GODELEV
liked a
Space 3 days ago
replied to Banaxi-Tech's post 3 days ago
You mentioned above XSA refresh gates ?
replied to Banaxi-Tech's post 3 days ago
So it does have Xsa as well ? along with reinjection of original token embeddings
liked 2
models 3 days ago
reacted to Banaxi-Tech's post with 🔥 3 days ago
Post
2678
Today.
- 9 replies