inland-turquoise•2y ago

Wait between session use

Is there any way to make sure a session is not used for X seconds after being use? Currently, I add a random sleep in the request handler and increased my concurrency, but it kind of feel hackish.

1 Reply

ondro_k•2y ago

Hi, there's only this: sameDomainDelaySecs. Dev's note:

I think that completely stops the crawler from crawling anything on that domain (it's not session-scoped). Also, the last time we've checked, it was unstable-ish, so their mileage may vary

const crawler = new PlaywrightCrawler({
    sameDomainDelaySecs: 10
});

const crawler = new PlaywrightCrawler({
    sameDomainDelaySecs: 10
});

Wait between session use

Did you find this page helpful?