exclusive-coralE
Apify & Crawlee•3y ago•
1 reply
exclusive-coral

Per request timeout

I can set an overall timeout for a crawler with requestHandlerTimeoutSecs like so:
const crawler = new PlaywrightCrawler({
    requestHandler: router,
    browserPoolOptions: {
        maxOpenPagesPerBrowser: 4,
    },
    requestHandlerTimeoutSecs: 3600,
})


Is there a way to set a timeout per page, rather than an overall timeout? E.g. if there is an exception being caught and the crawl then hangs, I was to timeout after 30 seconds on that page, but have a much longer timeout for the run overall
Was this page helpful?