Implementation of the Swin Transformer in PyTorch. - berniwal/swin-transformer-pytorch

The "tl;dr" on a few notable transformer papers (pre-2022). - will-thompson-k/tldr-transformers

Implementation of Fast Transformer in Pytorch. Contribute to lucidrains/fast-transformer-pytorch development by creating an account on GitHub.

Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch - lucidrains/RETRO-pytorch

Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways - lucidrains/PaLM-pytorch

Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch - lucidrains/flamingo-pytorch

Implementation of CoCa, Contrastive Captioners are Image-Text Foundation Models, in Pytorch - lucidrains/CoCa-pytorch

Implementation of Parti, Google's pure attention-based text-to-image neural network, in Pytorch - lucidrains/parti-pytorch

Implementation of AudioLM, a SOTA Language Modeling Approach to Audio Generation out of Google Research, in Pytorch - lucidrains/audiolm-pytorch

Implementation of Make-A-Video, new SOTA text to video generator from Meta AI, in Pytorch - lucidrains/make-a-video-pytorch