Impit part of Crawlee - Apify & Crawlee

Louis Deconinck · 2025-12-01T21:37:19.495Z

Will Impit become a part of Crawlee and replace GotScraping?

P

Pepa J•12/5/25, 9:35 AM

Hi @Louis Deconinck Yes, there is a plan to replace GotScraping with Impit and you can already use it by installing

@crawlee/impit-client

@crawlee/impit-client

@crawlee/impit-client

@crawlee/impit-client and passing the

new ImpitHttpClient()

new ImpitHttpClient()

new ImpitHttpClient()

new ImpitHttpClient() as the

httpClient

httpClient

httpClient

httpClient crawler constructor option.

M

memo23•12/5/25, 1:38 PM

@Pepa J what about cheerioCrawler?

M

memo23•12/5/25, 1:38 PM

I my case gotScraping starts to 'struggle' with websites

M

memo23•12/5/25, 1:45 PM

import { ImpitHttpClient } from '@crawlee/impit-client';
import { CheerioCrawler } from 'crawlee';
const crawler = new CheerioCrawler({
    // Pass the ImpitHttpClient as the httpClient option
    httpClient: new ImpitHttpClient({
        // Optional: you can specify browser impersonation
        // browser: 'chrome', // or 'firefox'
    }),
    
    // ... your other options
    proxyConfiguration,
    maxConcurrency,
    requestHandler: router,
    // etc.
});

import { ImpitHttpClient } from '@crawlee/impit-client';
import { CheerioCrawler } from 'crawlee';
const crawler = new CheerioCrawler({
    // Pass the ImpitHttpClient as the httpClient option
    httpClient: new ImpitHttpClient({
        // Optional: you can specify browser impersonation
        // browser: 'chrome', // or 'firefox'
    }),
    
    // ... your other options
    proxyConfiguration,
    maxConcurrency,
    requestHandler: router,
    // etc.
});

import { ImpitHttpClient } from '@crawlee/impit-client';
import { CheerioCrawler } from 'crawlee';
const crawler = new CheerioCrawler({
    // Pass the ImpitHttpClient as the httpClient option
    httpClient: new ImpitHttpClient({
        // Optional: you can specify browser impersonation
        // browser: 'chrome', // or 'firefox'
    }),
    
    // ... your other options
    proxyConfiguration,
    maxConcurrency,
    requestHandler: router,
    // etc.
});

import { ImpitHttpClient } from '@crawlee/impit-client';
import { CheerioCrawler } from 'crawlee';
const crawler = new CheerioCrawler({
    // Pass the ImpitHttpClient as the httpClient option
    httpClient: new ImpitHttpClient({
        // Optional: you can specify browser impersonation
        // browser: 'chrome', // or 'firefox'
    }),
    
    // ... your other options
    proxyConfiguration,
    maxConcurrency,
    requestHandler: router,
    // etc.
});

M

memo23•12/5/25, 1:46 PM

@Pepa J something like that, I guess cheerioCralwe uses or extends HttpCrawler?

P

Pepa J•12/5/25, 1:46 PM

Hi @memo23 Yes, the plan and also the approach that I proposed and that you can do now is meant to use with CheerioCrawler.
Your example looks good to me.

M

memo23•12/5/25, 1:47 PM

also can you give any best practices and is there any 'example' page for @crawlee/impit-client?

M

memo23•12/5/25, 1:47 PM

and it is quite faster @Pepa J

M

memo23•12/5/25, 1:49 PM

https://www.npmjs.com/package/@crawlee/impit-client readme.md needs some updates?

P

Pepa J•12/5/25, 1:52 PM

@memo23 You may check the configuration options at https://apify.github.io/impit/js/interfaces/ImpitOptions.html
It is true, that there are not many examples for usage with crawlee. I will ping our doc team about it, thanks!

ImpitOptions | impit

Documentation for impit

M

memo23•12/5/25, 1:54 PM

thank you @Pepa J and you saved my day today mate