maxRequestsPerCrawlmaxRequestsPerCrawl can be set on a crawler to crawler basis, but the issue with this approach is that the request queues are not getting purged after every crawl, resulting in the crawlers resuming the session from before. These are the approaches I triedpurgeRequestQueuepurgeRequestQueue to true explicitly in the crawler.run()crawler.run() func but it results in this errorDid not expect property Did not expect property purgeRequestQueue to exist, got to exist, got true in object in object options`
2. setting it as a global variable in `
2. setting it as a global variable in crawlee.json (it looks like crawlee is not picking up my crawlee.json file at all, because I tried to set logging levels in it and crawlee didnt pick it up).
3. tried using (it looks like crawlee is not picking up my crawlee.json file at all, because I tried to set logging levels in it and crawlee didnt pick it up).
3. tried using await purgeDefaultStorages()` in my entry file~~**Status update: We are experiencing some issues, and will update soon. Apologies for the inconvenience.**~~ Should be good now ๐ค
ellativity ยท 3d ago
**Apify paid out over $1M in developer earnings last month** Last month, for the first time, we sent over $1M to community developers for Actors they have published in Apify Store. These were earnings for the month of March, and we are looking forward to breaking this record again in April. Many heartfelt thanks to the community developers who are building, maintaining, and improving their Actors. We are so lucky to be in this together, and excited for what the future brings. Thank you! <a:keanuthanks:1430839059655426068>
ellativity ยท 4d ago
Hi all ๐ just a reminder that full permission Actors will soon (**May 4th**) require confirmation for new users.
hurt-tomato ยท 2w ago
Join the Discord to ask follow-up questions and connect with the community