wee-brown
wee-brown2y ago

setTimeout using routes

Hi, I am using crawlee with routes for a web scraping project. In my default route I am doing a infinitScroll, but It keeps failing because the scroll goes for more than 60 seconds. I can change the requestHandlerTimeoutSecs property in my crawler, but I would like to know if there is a way to change the timeout only in one route.
1 Reply
lemurio
lemurio2y ago
hey, that is currently not possible. You'd have to manually check for the timeouts in your routes to achieve this

Did you find this page helpful?