1. Ashish Vaswani , Noam Shazeer , Niki Parmar , Jakob Uszkoreit , Llion Jones , Aidan N. Gomez , Łukasz Kaiser , and Illia Polosukhin . Attention is all you need. Advances in Neural Information Processing Systems, 2017-December:5999–6009, 6 2017. ISSN 10495258.
2. Chitwan Saharia , William Chan , Saurabh Saxena , Lala Li , Jay Whang , Emily Denton , Seyed Kamyar Seyed Ghasemipour , Burcu Karagol Ayan , S. Sara Mahdavi , Rapha Gontijo Lopes , Tim Salimans , Jonathan Ho , David J Fleet , and Mohammad Norouzi . Photorealistic text-to-image diffusion models with deep language understanding. 5 2022.
3. Aditya Ramesh , Prafulla Dhariwal , Alex Nichol , Casey Chu , and Mark Chen OpenAI . Hier-archical text-conditional image generation with clip latents. 4 2022.
4. A survey of transformers
5. Bert: Pre-training of deep bidirectional transformers for language understanding;NAACL HLT 2019 - 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies - Proceedings of the Conference,2018