https://universetechguru.blogspot.com/2020/02/optimize-your-robotstxt-file.html