Using `transformRequestFunction` in `enqueueLinks` overrides `label`

exclusive-coral · 2023-12-18T14:26:00.066Z

I am using `enqueueLinks` to pass some URLs to another handler. This works fine when I do: ```ts await enqueueLinks({ label: "LIST_PLACES", urls: searchSquareLinks, strategy: "same-domain", userData, }) ``` but as soon as I add a `transformRequestFunction` the label is overridden and it queues the links back to the handler from which is is being queued: ```ts await enqueueLinks({ label: "LIST_PLACES", urls: searchSquareLinks, transformRequestFunction: (request) => { request.userData = { ...userData, zoomTarget: request.url.match(zoomRegex)?.[1], } return request }, strategy: "same-domain", userData, }) ``` Why is the `label` being overridden when the only property of `request` being changed is the `zoomTarget`?

I am using

enqueueLinks

enqueueLinks

to pass some URLs to another handler. This works fine when I do:

await enqueueLinks({
    label: "LIST_PLACES",
    urls: searchSquareLinks,
    strategy: "same-domain",
    userData,
})

await enqueueLinks({
    label: "LIST_PLACES",
    urls: searchSquareLinks,
    strategy: "same-domain",
    userData,
})

but as soon as I add a

transformRequestFunction

transformRequestFunction

the label is overridden and it queues the links back to the handler from which is is being queued:

await enqueueLinks({
    label: "LIST_PLACES",
    urls: searchSquareLinks,
    transformRequestFunction: (request) => {
        request.userData = {
            ...userData,
            zoomTarget: request.url.match(zoomRegex)?.[1],
        }
        return request
    },
    strategy: "same-domain",
    userData,
})

await enqueueLinks({
    label: "LIST_PLACES",
    urls: searchSquareLinks,
    transformRequestFunction: (request) => {
        request.userData = {
            ...userData,
            zoomTarget: request.url.match(zoomRegex)?.[1],
        }
        return request
    },
    strategy: "same-domain",
    userData,
})

Why is the

label

label

being overridden when the only property of

request

request

being changed is the

zoomTarget

zoomTarget

Apify & Crawlee•3y ago•

5 replies

exclusive-coral

Using `transformRequestFunction` in `enqueueLinks` overrides `label`

I am using

enqueueLinks

enqueueLinks

to pass some URLs to another handler. This works fine when I do:

await enqueueLinks({
    label: "LIST_PLACES",
    urls: searchSquareLinks,
    strategy: "same-domain",
    userData,
})

await enqueueLinks({
    label: "LIST_PLACES",
    urls: searchSquareLinks,
    strategy: "same-domain",
    userData,
})

but as soon as I add a

transformRequestFunction

transformRequestFunction

the label is overridden and it queues the links back to the handler from which is is being queued:

await enqueueLinks({
    label: "LIST_PLACES",
    urls: searchSquareLinks,
    transformRequestFunction: (request) => {
        request.userData = {
            ...userData,
            zoomTarget: request.url.match(zoomRegex)?.[1],
        }
        return request
    },
    strategy: "same-domain",
    userData,
})

await enqueueLinks({
    label: "LIST_PLACES",
    urls: searchSquareLinks,
    transformRequestFunction: (request) => {
        request.userData = {
            ...userData,
            zoomTarget: request.url.match(zoomRegex)?.[1],
        }
        return request
    },
    strategy: "same-domain",
    userData,
})

Why is the

label

label

being overridden when the only property of

request

request

being changed is the

zoomTarget

zoomTarget

Using `transformRequestFunction` in `enqueueLinks` overrides `label`

Similar Threads

Using `transformRequestFunction` in `enqueueLinks` overrides `label`

Similar Threads

Similar Threads

Similar Threads