Hello guys,

Hello guys,

I have pupeteerCrawler
in the requestHandler I'm trying to click to the pagination next button and I cannot determine if the content is changed or not.
How can I do it? waitfornetworkidle does not seem to work here. any ideas?

moderate-tomato•5/30/24, 8:27 AM

if url is changing as you change the page i would suggest using all the pagination urls and put it in enque.

ripe-grayOP•5/30/24, 10:21 AM

@kprocks that what I did eventually, but I was never able to make it work as plannaed initially