https://apix-drive.com/en/blog/ecommerce/robots-txt-definition