AdaptivePlaywrightCrawler starts crawling the whole web at some point.

I want to use the AdaptivePlaywrightCrawler, but it seems like it wants to crawl the entire web.
Here is my code.

const crawler = new AdaptivePlaywrightCrawler({
      renderingTypeDetectionRatio: 0.1,
      maxRequestsPerCrawl: 50,
      async requestHandler({ request, enqueueLinks, parseWithCheerio, querySelector, log, urls }) {
        console.log(request.url, request.uniqueKey);
        await enqueueLinks();
      }
});

crawler.run(['https://crawlee.dev']);

const crawler = new AdaptivePlaywrightCrawler({
      renderingTypeDetectionRatio: 0.1,
      maxRequestsPerCrawl: 50,
      async requestHandler({ request, enqueueLinks, parseWithCheerio, querySelector, log, urls }) {
        console.log(request.url, request.uniqueKey);
        await enqueueLinks();
      }
});

crawler.run(['https://crawlee.dev']);

Hall•1/10/25, 6:11 PM

Someone will reply to you shortly. In the meantime, this might help:

moderate-tomatoOP•1/10/25, 6:15 PM

By the way, I've tried with strategy: 'same-domain', 'same-origin' but the result was the same.

Exp•1/10/25, 6:49 PM

Hi you have to restrict crawling to specific domains or patterns

moderate-tomatoOP•1/10/25, 10:27 PM

Hey, thanks! That kinda works, but I thought the default behavior of enqueueLinks was to stay on the same hostname. It's clearly mentioned in the documentation: https://crawlee.dev/docs/introduction/adding-urls

Adding more URLs | Crawlee · Build reliable crawlers. Fast.

Crawlee helps you build and maintain your crawlers. It's open source, but built by developers who scrape millions of pages every day for a living.