hpcaitech/ColossalAI
Colossal-AI: A Unified Deep Learning System for Large-Scale Parallel Training
👨💻: #Python #Cuda #Cpp
⭐: 1575 🍴: 178
#deep_learning #distributed_training #hpc #large_scale #data_parallelism #pipeline_parallelism #model_parallelism
Colossal-AI: A Unified Deep Learning System for Large-Scale Parallel Training
👨💻: #Python #Cuda #Cpp
⭐: 1575 🍴: 178
#deep_learning #distributed_training #hpc #large_scale #data_parallelism #pipeline_parallelism #model_parallelism
hpcaitech/ColossalAI
Colossal-AI: A Unified Deep Learning System for Big Model Era
👨💻: #Python #Cuda #Cpp
⭐: 3476 🍴: 377
#deep_learning #hpc #large_scale #data_parallelism #pipeline_parallelism #model_parallelism #ai #big_model #distributed_computing #inference #heterogeneous_training
Colossal-AI: A Unified Deep Learning System for Big Model Era
👨💻: #Python #Cuda #Cpp
⭐: 3476 🍴: 377
#deep_learning #hpc #large_scale #data_parallelism #pipeline_parallelism #model_parallelism #ai #big_model #distributed_computing #inference #heterogeneous_training
hpcaitech/ColossalAI
Colossal-AI: A Unified Deep Learning System for Big Model Era
👨💻: #Python #Cuda #Cpp
⭐: 6591 🍴: 628
#deep_learning #hpc #large_scale #data_parallelism #pipeline_parallelism #model_parallelism #ai #big_model #distributed_computing #inference #heterogeneous_training
Colossal-AI: A Unified Deep Learning System for Big Model Era
👨💻: #Python #Cuda #Cpp
⭐: 6591 🍴: 628
#deep_learning #hpc #large_scale #data_parallelism #pipeline_parallelism #model_parallelism #ai #big_model #distributed_computing #inference #heterogeneous_training
microsoft/DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
👨💻: #Python #Cuda #Cpp
⭐: 9076 🍴: 1091
#deep_learning #pytorch #gpu #machine_learning #billion_parameters #data_parallelism #model_parallelism #inference #pipeline_parallelism #compression #mixture_of_experts #trillion_parameters #zero
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
👨💻: #Python #Cuda #Cpp
⭐: 9076 🍴: 1091
#deep_learning #pytorch #gpu #machine_learning #billion_parameters #data_parallelism #model_parallelism #inference #pipeline_parallelism #compression #mixture_of_experts #trillion_parameters #zero