https://dexodata.com/en/blog/large-scale-web-scraping-guide-to-efficient-practices