HPC Guru (Twitter)

👇🧵 by @CerebrasSystems on #SlimPajama – the largest deduplicated, multi-corpora, open-source, dataset for training LLMs

Cute mascot!

Cerebras built #SlimPajama to train a #LLaMA style model for partner @Opentensor

https://www.cerebras.net/blog/slimpajama-a-627b-token-cleaned-and-deduplicated-version-of-redpajama

#AI #GenerativeAI
-----------
@CerebrasSystems:
📣 New dataset drop!
Introducing SlimPajama-627B: the largest extensively deduplicated, multi-corpora, open-source dataset for training large language models. 🧵https://t.co/bwsSz4d9hs https://t.co/3Ow1OAEcS9