
RequestQueue. This is something you can pass into the crawler when you call the constructor on it. You can call open on it statically and then also assign it an id. This will now put it in storage under the ID and not default. It looks like soRequestQueue also has a drop method which is suppose to remove it from the storage for you. (however I'm not entirely certain I've got this working completely yet)RequestQueue in a requestQueue variable. Once the crawler has finsihed running. I call requestQueue.drop() hopefully this is tidying up the storage but I'm currently still not totally sure. I hope this helps you out a bit!RequestQueueRequestQueueRequestQueuerequestQueuerequestQueue.drop()const id = `${parsedUrl.host}_${Date.now()}`;
const requestQueue = await RequestQueue.open(id);await crawler.run();
// removes it from storage
await requestQueue.drop();