re-enqueue request without throwing error

NNeoNomade Is there any method of doing a request again without throwing an error but also ...

I

Isaac Olads•7/17/25, 9:45 PM

Yes, there is a method you can go by, you can retry a request on failure while respecting a maximum retry limit

N

NeoNomadeOP•7/17/25, 9:46 PM

And what method would that be ?

L

Lukas Celnar•7/23/25, 7:48 AM

Hi @NeoNomade
If you just want to suppress the error message it is easier to hack it like this:

const originalErrorLog = crawler.log.error.bind(crawler.log);
    crawler.log.error = (message: string, data?: Record<string, unknown> | null) => {
        if (message.includes(HIDE_MESSAGE_WATERMARK)) {
            return;
        }
        originalErrorLog(message, data);
    };

const originalErrorLog = crawler.log.error.bind(crawler.log);
    crawler.log.error = (message: string, data?: Record<string, unknown> | null) => {
        if (message.includes(HIDE_MESSAGE_WATERMARK)) {
            return;
        }
        originalErrorLog(message, data);
    };

const originalErrorLog = crawler.log.error.bind(crawler.log);
    crawler.log.error = (message: string, data?: Record<string, unknown> | null) => {
        if (message.includes(HIDE_MESSAGE_WATERMARK)) {
            return;
        }
        originalErrorLog(message, data);
    };

const originalErrorLog = crawler.log.error.bind(crawler.log);
    crawler.log.error = (message: string, data?: Record<string, unknown> | null) => {
        if (message.includes(HIDE_MESSAGE_WATERMARK)) {
            return;
        }
        originalErrorLog(message, data);
    };

Other option is to enqueue a new request and update its retryCount and uniqueKey