I have 99 urls in the queue. But scraper finishes crawl after a few urls, why?
The scraper finishes crawl after a few ones everytime. I have 99 urls added to the queue.
This is my config:
This is my config:


const playRequestQ = await RequestQueue.open('q1');
const urlsToAdd: { url: string; }[] = []
nodeEvts.on('links', onLinks)
async function onLinks(link: any;) {
urlsToAdd.push({ url: `${link}` })
if (urlsToAdd.length % 99 === 0) {
await playRequestQ.addRequests(urlsToAdd)
crawler.run();
}
}