lucidrains/vit-pytorch
Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
Language: Python
#artificial_intelligence #attention_mechanism #computer_vision #image_classification #transformers
Stars: 242 Issues: 1 Forks: 15
https://github.com/lucidrains/vit-pytorch

lucidrains/DALLE-pytorch
Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch
Language: Python
#artificial_intelligence #attention_mechanism #deep_learning #text_to_image
Stars: 472 Issues: 2 Forks: 23
https://github.com/lucidrains/DALLE-pytorch

lucidrains/bottleneck-transformer-pytorch
Implementation of Bottleneck Transformer - Pytorch
Language: Python
#artificial_intelligence #attention_mechanism #deep_learning #image_classification #transformers #vision
Stars: 122 Issues: 1 Forks: 7
https://github.com/lucidrains/bottleneck-transformer-pytorch

lucidrains/fast-transformer-pytorch
Implementation of Fast Transformer in Pytorch
Language: Python
#artificial_intelligence #attention_mechanism #deep_learning #transformers
Stars: 90 Issues: 0 Forks: 8
https://github.com/lucidrains/fast-transformer-pytorch

lucidrains/RETRO-pytorch
Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch
Language: Python
#artificial_intelligence #attention_mechanism #deep_learning #retrieval #transformers
Stars: 102 Issues: 0 Forks: 2
https://github.com/lucidrains/RETRO-pytorch

lucidrains/PaLM-pytorch
Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways
Language: Python
#artificial_general_intelligence #attention_mechanism #deep_learning #transformers
Stars: 147 Issues: 0 Forks: 8
https://github.com/lucidrains/PaLM-pytorch

lucidrains/flamingo-pytorch
Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch
Language: Python
#artificial_intelligence #attention_mechanism #deep_learning #transformers #visual_question_answering
Stars: 131 Issues: 0 Forks: 3
https://github.com/lucidrains/flamingo-pytorch

lucidrains/CoCa-pytorch
Implementation of CoCa, Contrastive Captioners are Image-Text Foundation Models, in Pytorch
Language: Python
#artificial_intelligence #attention_mechanism #contrastive_learning #deep_learning #image_to_text #multimodal #transformers
Stars: 90 Issues: 0 Forks: 2
https://github.com/lucidrains/CoCa-pytorch

lucidrains/parti-pytorch
Implementation of Parti, Google's pure attention-based text-to-image neural network, in Pytorch
Language: Python
#artificial_intelligence #attention_mechanism #deep_learning #text_to_image #transformers
Stars: 143 Issues: 0 Forks: 2
https://github.com/lucidrains/parti-pytorch

lucidrains/soundstorm-pytorch
Implementation of SoundStorm, Efficient Parallel Audio Generation from Google Deepmind, in Pytorch
Language: Python
#artificial_intelligence #attention_mechanism #audio_generation #deep_learning #non_autoregressive #transformers
Stars: 181 Issues: 0 Forks: 6
https://github.com/lucidrains/soundstorm-pytorch

kyegomez/MultiModalMamba
A novel implementation of fusing ViT with Mamba into a fast, agile, and high performance Multi-Modal Model. Powered by Zeta, the simplest AI framework ever.
Language: Python
#ai #artificial_intelligence #attention_mechanism #machine_learning #mamba #ml #pytorch #ssm #torch #transformer_architecture #transformers #zeta
Stars: 264 Issues: 0 Forks: 9
https://github.com/kyegomez/MultiModalMamba