Rrubber-blue
Handling pagination within Apify task?
I've created a Playwright scraper task in the Apify web app.
I'm trying to sort out how to handle pagination that -
* uses a link bar bar (instead of lazy loading items)
* doesn't show the last page number until you've navigated within a few pages of end
* uses <button> elements for page links (instead of anchor tags with hrefs)
I want to navigate all of these pages to collect URLs that will be queued for scraping.
The docs mention there's a way to collect paginated URLs using the
What would be best way to handle this kind of pagination?
Thanks for any help.
---
I'm trying to sort out how to handle pagination that -
* uses a link bar bar (instead of lazy loading items)
* doesn't show the last page number until you've navigated within a few pages of end
* uses <button> elements for page links (instead of anchor tags with hrefs)
I want to navigate all of these pages to collect URLs that will be queued for scraping.
The docs mention there's a way to collect paginated URLs using the
Pseudo URLsWhat would be best way to handle this kind of pagination?
Thanks for any help.
---
Apify
Learn how to scrape a website using Apify's Web Scraper. Build an actor's page function, extract information from a web page and download your data.
This is the official developer community of Apify and Crawlee.
14,091Members
Resources
Recent Announcements
Similar Threads
Was this page helpful?
