rare-sapphire•16mo ago

Hi there! Does anybody know how to

Hi there! Does anybody know how to increase HTTPCrawler Requests timeouts? According to the docs there is requestQueue.timeoutSecs property but even when it is set to e.g. 60 secs all my HTTPCrawler requests are failed after 30 sec timeout 😦

2 Replies

HonzaS•16mo ago

I guess you want to set this https://crawlee.dev/api/http-crawler/interface/HttpCrawlerOptions#navigationTimeoutSecs

ambitious-aqua•16mo ago

I did it with pre navigation hooks already but this seems to be a bit easier while the name of this param in context of HTTPCrawler is misleading as hell 🙂 thanks for the hint tho

Hi there! Does anybody know how to

Did you find this page helpful?