xenial-black•13mo ago
Will crawlee scrape data loaded from JS that is triggered by scroll?
Looking for a solution for scraping a website that fills in product details via JS on scroll.
Will crawlee “scroll” and scrape after these loads or will this require other means?
Thank you!
2 Replies
Post created!
This post has been synced with the Apify community site and will be indexed by search engines
Yes, sure.
Here is a blogpost about it:
https://crawlee.dev/blog/infinite-scroll-using-python
How to scrape infinite scrolling webpages with Python | Crawlee · B...
Crawlee helps you build and maintain your crawlers. It's open source, but built by developers who scrape millions of pages every day for a living.