deep-jade•2y ago

better error handling?

WARN  PlaywrightCrawler: Reclaiming failed request back to the list or queue. Navigation timed out after 60 seconds. {"id":"icvnyTXX7zWJjgV","url":"https://www.gastongov.com/486/Transportation-Planning","retryCount":2}

WARN  PlaywrightCrawler: Reclaiming failed request back to the list or queue. Navigation timed out after 60 seconds. {"id":"icvnyTXX7zWJjgV","url":"https://www.gastongov.com/486/Transportation-Planning","retryCount":2}

any way to get more data / error handle better than this?

2 Replies

Alexey Udovydchenko•2y ago

you can customize it by https://crawlee.dev/api/playwright-crawler/interface/PlaywrightCrawlerOptions#errorHandler

Lukas Krivka•2y ago

There isn't much more data to get from timeout. This is just timeout from Playwright, there is nothing else there really

better error handling?

Did you find this page helpful?