A small Mixtral-style Mixture-of-Experts causal language model for pretraining research on a single consumer GPU.
Michael Lee
mikecovlee
·
AI & ML interests
LLM
Recent Activity
updated a model 1 day ago
mikecovlee/tinymixtral-1B updated a collection 1 day ago
Tiny Mixtral published a model 1 day ago
mikecovlee/tinymixtral-1BOrganizations
