Apify Discord Mirror

Updated 5 months ago

more than one request queue

At a glance

The post asks if it is possible to create two request queues per .run(). The community members in the comments suggest that you can create a named queue, and if running on a platform, it's a good practice to use a run ID in the name. They also mention that you may need to drop the queue after finishing, otherwise it won't get deleted. One community member shares their solution of using a differently named queue, web_crawler_next, in addition to the original web_crawler queue.

Is it possible to create two request queues per
.run()?
v
b
4 comments
Hi ,
you can create a named queue. If you are running it on a platform and want it to be tied to a specific Actor run, good practice is to use a run ID in the name. You may also drop the queue after finishing, otherwise the queue will not get deleted at all (also applies only if you are using the Apify platform).
Plain Text
  await web_crawler.run()
  web_crawler.requestQueue = web_crawler_next
  await web_crawler.run()
I ended up doing this.
(web_crawler_next being a differently named named queue)
Add a reply
Sign up and join the conversation on Discord