https://www.robotstxtseo.com/2025/04/use-robots-txt-to-prevent-duplicate-content-issue.html