rare-sapphire•2y ago

Playwright: aborting routes

Hi, Since the "requestHandler" is called after the crawler goes to the URL to be crawled, I can I tell the Playwright crawler which routes to abort so it doesn't unecessarily fetch things that are not needed? Normally I'd page.route("expression", route => route.abort()) before page.goto()

2 Replies

HonzaS•2y ago

You can try to put it there https://crawlee.dev/api/playwright-crawler/interface/PlaywrightCrawlerOptions#preNavigationHooks

PlaywrightCrawlerOptions | API | Crawlee

rare-sapphireOP•2y ago

Awesome, thanks @HonzaS !

Playwright: aborting routes

Did you find this page helpful?