like-gold•16mo ago
Hello guys,
Hello guys,
I have pupeteerCrawler
in the requestHandler I'm trying to click to the pagination next button and I cannot determine if the content is changed or not.
How can I do it? waitfornetworkidle does not seem to work here. any ideas?
2 Replies
ratty-blush•16mo ago
if url is changing as you change the page i would suggest using all the pagination urls and put it in enque.
sensitive-blue•16mo ago
@kprocks that what I did eventually, but I was never able to make it work as plannaed initially