Is it possible to run a crawl within a crawl?

At a glance

The community member has set up a crawler (x) that collects links from a page, and they want to run another crawler (y) within the x crawl to collect more data and return it with the rest of the x crawl data. They are unsure if this is possible. The comments suggest that instead of running a crawl within a crawl, the community member should set up separate request queues for each crawler, and in the first crawler, they can add new requests to the second request queue and pass partial information using the request's user data. This way, the second crawler can access the data from the first crawler and process it further.

JJimpex

I have a crawler I have setup (x) that collects links from a page. I want to run another crawler(y) within x crawl to collect more data and return it with the rest of x crawl data. Is it possible to do this?

(I know you can add requests to the queue from a crawl but I want to keep the data together)

example data structure:

Plain Text

const data = [{
    // from "x" crawl
    title: 'a page',
    links: [
        {
            // from "y" crawl
            title: 'a page',
            link: 'link'
        }
    ]
}]