Duplicate results from multiple runs
Hey,
When I run an actor, I can resurrect it, and I assume there will be no duplicate results.
But when I want to change some settings, it's a new run, it probably re-runs urls I already ran in the previous run.
Is there a way to avoid this? Let's say an actor for businesses (google, yelp, yell etc) runs for London, and i start a new run for a new location or a location within london that might have overlap.
How do I avoid paying again for duplicates? Is there a setting to avoid re-running urls that have already run in a previous runs?
Thanks,
When I run an actor, I can resurrect it, and I assume there will be no duplicate results.
But when I want to change some settings, it's a new run, it probably re-runs urls I already ran in the previous run.
Is there a way to avoid this? Let's say an actor for businesses (google, yelp, yell etc) runs for London, and i start a new run for a new location or a location within london that might have overlap.
How do I avoid paying again for duplicates? Is there a setting to avoid re-running urls that have already run in a previous runs?
Thanks,
This is the official developer community of Apify and Crawlee.
13,739Members
Resources
Recent Announcements
Similar Threads
Was this page helpful?
