seems like a large undertrained model, not that exciting imo compared to mixtral...

		whimsicalism on March 18, 2024 \| parent \| context \| favorite \| on: Grok seems like a large undertrained model, not that exciting imo compared to mixtral it is also not the biggest model oss, switch transformer was released years ago and is larger and similarly undertrained