Hi,
Hi,
I’m using APIFY to scrape reviews for a business that has around 500,000 reviews. I’m running the scraper daily, but I don’t want to re-fetch all 500K reviews every day.
Most scrapers on APIFY don’t offer cursor, offset, or limit parameters.
Is there any built-in mechanism in APIFY to handle this kind of incremental scraping?
Or any recommended approach to avoid retrieving everything on each run?
Thanks.
I’m using APIFY to scrape reviews for a business that has around 500,000 reviews. I’m running the scraper daily, but I don’t want to re-fetch all 500K reviews every day.
Most scrapers on APIFY don’t offer cursor, offset, or limit parameters.
Is there any built-in mechanism in APIFY to handle this kind of incremental scraping?
Or any recommended approach to avoid retrieving everything on each run?
Thanks.
