3 replies

crawler process not exiting after teardown is called.

I am running a Playwright crawler and I call

await crawler.teardown()

await crawler.teardown()

after some condition is met,

Issue with this approach is that the crawlee process hangs indefinitely and doesn't exit even after a while. I have to force stop it using CTRL + C, on searching github, it looks like its an issue with some timeouts but I havent set one anywhere.

here's how I am initializing my crawler:

export const crawler = new PlaywrightCrawler({
    requestHandler:router,
    maxRequestsPerMinute:10,
})

export const crawler = new PlaywrightCrawler({
    requestHandler:router,
    maxRequestsPerMinute:10,
})

and I have a playwright config where I have set the default timeout

import { defineConfig } from '@playwright/test';

export default defineConfig({
    timeout: 3000,
});

import { defineConfig } from '@playwright/test';

export default defineConfig({
    timeout: 3000,
});

crawler process not exiting after teardown is called.

Similar Threads