Apify Discord Mirror

B
BOBPG
Offline, last seen 5 months ago
Joined August 30, 2024
Hi,

I'm using the apify/web-scraper to scrape a website. The pages don't initially load all the content, you need to scroll down to see more.

Now i have set the scroll distance setting to the highest number possible but still it only works half of the time.

Is there any way to improve the scroll behavior? Right now works on only let's say 50% of the requests, on what pages it works is different each run. Is there another way to control this functionality?

Thanks,
Bob
3 comments
B
L
M
Hey,

When I run an actor, I can resurrect it, and I assume there will be no duplicate results.

But when I want to change some settings, it's a new run, it probably re-runs urls I already ran in the previous run.

Is there a way to avoid this? Let's say an actor for businesses (google, yelp, yell etc) runs for London, and i start a new run for a new location or a location within london that might have overlap.
How do I avoid paying again for duplicates? Is there a setting to avoid re-running urls that have already run in a previous runs?

Thanks,
3 comments
v
B