slow-yellowS
Apify & Crawlee14mo ago
6 replies
slow-yellow

Parsel Crawler way too dank with request speed

Hi everyone! I am creating a crawler using crawlee for python. I noticed the Parsel crawler makes the requests in much higher frequency than the Beautiful soup crawler. Is there a way to make the Parsel crawler slower, so we avoid getting blocked better? Thanks!
Was this page helpful?