Is it possible to get the selector of the individual links when using enqueueLinks()?

await enqueueLinks({
  selector: 'a',
  strategy: 'same-hostname',
  forefront: true,
  transformRequestFunction: (request) => {
    request.userData.parentUrl = page.url();
    request.userData.subRequest = true;
    request.userData.linkSelector = xxx; // <-- Is it possible to save the selectors of each link?

    return request;
  },
});

await enqueueLinks({
  selector: 'a',
  strategy: 'same-hostname',
  forefront: true,
  transformRequestFunction: (request) => {
    request.userData.parentUrl = page.url();
    request.userData.subRequest = true;
    request.userData.linkSelector = xxx; // <-- Is it possible to save the selectors of each link?

    return request;
  },
});

Apify & Crawlee•3y ago•

4 replies

ordinary-sapphire

Is it possible to get the selector of the individual links when using enqueueLinks()?

await enqueueLinks({
  selector: 'a',
  strategy: 'same-hostname',
  forefront: true,
  transformRequestFunction: (request) => {
    request.userData.parentUrl = page.url();
    request.userData.subRequest = true;
    request.userData.linkSelector = xxx; // <-- Is it possible to save the selectors of each link?

    return request;
  },
});

await enqueueLinks({
  selector: 'a',
  strategy: 'same-hostname',
  forefront: true,
  transformRequestFunction: (request) => {
    request.userData.parentUrl = page.url();
    request.userData.subRequest = true;
    request.userData.linkSelector = xxx; // <-- Is it possible to save the selectors of each link?

    return request;
  },
});

Continue the conversation

Join the Discord to ask follow-up questions and connect with the community

A&C

Apify & Crawlee

This is the official developer community of Apify and Crawlee.

14,851 Members

Join

Is it possible to get the selector of the individual links when using enqueueLinks()?

Is it possible to get the selector of the individual links when using enqueueLinks()?

Continue the conversation

Apify & Crawlee

Continue the conversation

Apify & Crawlee

Similar Threads