How to launch a crawlee browser that I can manually pass the cloudfare anti-bot protection

This is my code to launch the browser with headless: false mode. I mannualy input the URL and try to pass the captcha challenges. But the challenges keep failing
This is the code

const { launchPuppeteer } = require('crawlee');
const puppeteerExtra = require('puppeteer-extra');
const stealthPlugin = require('puppeteer-extra-plugin-stealth');

// Use the stealth plugin
puppeteerExtra.use(stealthPlugin());

const main = async () => {
    // Launch the browser without running any crawl
    const browser = await launchPuppeteer({
        // !!! You need to specify this option to tell Crawlee to use puppeteer-extra as the launcher !!!
        launcher: puppeteerExtra,
        launchOptions: {
            // Other puppeteer options work as usual
            headless: false,
        },
    });

    // Create and navigate new page 
    console.log('Open target page');
    const page = await browser.newPage();

    // Now you can play around with the browser
    console.log('Browser launched. You can now interact with it.');
    
    // Keep the script running
    await new Promise((resolve) => {
        console.log('Press Ctrl+C to exit.');
    });
};

main().catch(console.error);

const { launchPuppeteer } = require('crawlee');
const puppeteerExtra = require('puppeteer-extra');
const stealthPlugin = require('puppeteer-extra-plugin-stealth');

// Use the stealth plugin
puppeteerExtra.use(stealthPlugin());

const main = async () => {
    // Launch the browser without running any crawl
    const browser = await launchPuppeteer({
        // !!! You need to specify this option to tell Crawlee to use puppeteer-extra as the launcher !!!
        launcher: puppeteerExtra,
        launchOptions: {
            // Other puppeteer options work as usual
            headless: false,
        },
    });

    // Create and navigate new page 
    console.log('Open target page');
    const page = await browser.newPage();

    // Now you can play around with the browser
    console.log('Browser launched. You can now interact with it.');
    
    // Keep the script running
    await new Promise((resolve) => {
        console.log('Press Ctrl+C to exit.');
    });
};

main().catch(console.error);

This is the test URL
https://www.nivod.cc/

Apify & Crawlee•2y ago•

4 replies

forward-apricot

How to launch a crawlee browser that I can manually pass the cloudfare anti-bot protection

This is my code to launch the browser with headless: false mode. I mannualy input the URL and try to pass the captcha challenges. But the challenges keep failing
This is the code

const { launchPuppeteer } = require('crawlee');
const puppeteerExtra = require('puppeteer-extra');
const stealthPlugin = require('puppeteer-extra-plugin-stealth');

// Use the stealth plugin
puppeteerExtra.use(stealthPlugin());

const main = async () => {
    // Launch the browser without running any crawl
    const browser = await launchPuppeteer({
        // !!! You need to specify this option to tell Crawlee to use puppeteer-extra as the launcher !!!
        launcher: puppeteerExtra,
        launchOptions: {
            // Other puppeteer options work as usual
            headless: false,
        },
    });

    // Create and navigate new page 
    console.log('Open target page');
    const page = await browser.newPage();

    // Now you can play around with the browser
    console.log('Browser launched. You can now interact with it.');
    
    // Keep the script running
    await new Promise((resolve) => {
        console.log('Press Ctrl+C to exit.');
    });
};

main().catch(console.error);

const { launchPuppeteer } = require('crawlee');
const puppeteerExtra = require('puppeteer-extra');
const stealthPlugin = require('puppeteer-extra-plugin-stealth');

// Use the stealth plugin
puppeteerExtra.use(stealthPlugin());

const main = async () => {
    // Launch the browser without running any crawl
    const browser = await launchPuppeteer({
        // !!! You need to specify this option to tell Crawlee to use puppeteer-extra as the launcher !!!
        launcher: puppeteerExtra,
        launchOptions: {
            // Other puppeteer options work as usual
            headless: false,
        },
    });

    // Create and navigate new page 
    console.log('Open target page');
    const page = await browser.newPage();

    // Now you can play around with the browser
    console.log('Browser launched. You can now interact with it.');
    
    // Keep the script running
    await new Promise((resolve) => {
        console.log('Press Ctrl+C to exit.');
    });
};

main().catch(console.error);

This is the test URL
https://www.nivod.cc/

Continue the conversation

Join the Discord to ask follow-up questions and connect with the community

A&C

Apify & Crawlee

This is the official developer community of Apify and Crawlee.

15,894 Members

Join

How to launch a crawlee browser that I can manually pass the cloudfare anti-bot protection

How to launch a crawlee browser that I can manually pass the cloudfare anti-bot protection

Continue the conversation

Apify & Crawlee

Continue the conversation

Apify & Crawlee

Similar Threads