https://casualganpapers.com/fast-vqgan-clip-text-to-image-generation/CLIP-GEN-explained.html
Check out this paper summary