https://dexodata.com/en/blog/how-to-collect-web-data-at-scale-and-overcome-obstacles