THE LAB #2: scraping data from a website with Datadome and xsrf tokens

What is Datadome?

Datadome Bot protection is one of the key players in the anti-bot software industry.

As stated on their website, the solution is used on several important websites such as FootLocker, Rakuten, and even Reddit, as you can see from the picture below.

Datadome on Reddit

So, sooner or later, in your life as a web scraper, you'll surely face one website protected with this technology.

These days I needed to update a scraper that eluded Datadome so it's a good time for writing the process that allowed me to scrape the data from this website.

Continue reading