Is there a gentle way to run a crawler for x minutes?
I understand there's a way to stop crawling after x number of requests with maxRequestsPerCrawl
2 Replies
You can set any timeout you want.
More info here:
https://docs.apify.com/platform/actors/running/input-and-output#options---build-timeout-and-memory
Input and output | Platform | Apify Documentation
Configure your Actor's input parameters using Apify Console, locally or via API. Access parameters in key-value stores from your Actor's code.
Thanks Oleg but I'm not using Apify, I'm running crawlee.dev locally.