How to use Playwright's bypassCsp option?

brilliant-lime · 2024-09-23T08:23:38.669Z

I would like to use: https://playwright.dev/docs/api/class-testoptions#test-options-bypass-csp Any idea how I can do that in crawlee?

H

Hall•9/23/24, 8:23 AM

View post on community site

This post has been pushed to the community knowledgebase. Any replies in this thread will be synced to the community site.

Apify Community

B

brilliant-limeOP•9/29/24, 11:08 AM

Bump.

L

Lukas Celnar•9/30/24, 1:48 PM

Hi @Jeno
You can try:

const playwrightCrawler = new PlaywrightCrawler({
    launchContext: {
        launchOptions: { bypassCSP: true },
    },
});

const playwrightCrawler = new PlaywrightCrawler({
    launchContext: {
        launchOptions: { bypassCSP: true },
    },
});

const playwrightCrawler = new PlaywrightCrawler({
    launchContext: {
        launchOptions: { bypassCSP: true },
    },
});

const playwrightCrawler = new PlaywrightCrawler({
    launchContext: {
        launchOptions: { bypassCSP: true },
    },
});

B

brilliant-limeOP•10/7/24, 3:17 PM

Hi @Lukas Celnar ,

I get this ts error:

Object literal may only specify known properties, and 'bypassCSP' does not exist in type 'LaunchOptions'. ts(2353)

L

Lukas Celnar•10/7/24, 5:12 PM

Hi @Jeno
Could you please confirm that you are using playwright with latest version of crawlee?

I was able to successfully run this exact code without any error and typescript error/warning:

const crawler = new PlaywrightCrawler({
    proxyConfiguration,
    requestHandler: router,
    headless: false,
    launchContext: {
        launchOptions: { bypassCSP: true },
    },
});

const crawler = new PlaywrightCrawler({
    proxyConfiguration,
    requestHandler: router,
    headless: false,
    launchContext: {
        launchOptions: { bypassCSP: true },
    },
});

const crawler = new PlaywrightCrawler({
    proxyConfiguration,
    requestHandler: router,
    headless: false,
    launchContext: {
        launchOptions: { bypassCSP: true },
    },
});

const crawler = new PlaywrightCrawler({
    proxyConfiguration,
    requestHandler: router,
    headless: false,
    launchContext: {
        launchOptions: { bypassCSP: true },
    },
});

B

brilliant-limeOP•10/7/24, 6:51 PM

Indeed, I just updated Playwright version and it accepts the option. Thank you for your help!