Oordinary-sapphire
Avoid sharing same CheerioCrawler instance across multiple calls
Hi, I'm initializing a
new CheerioCrawler()new CheerioCrawler() when ever a POST request is received by my server, but even though I make a new instance of CheerioCrawler for each request, they seem to be affected by configs like maxRequestsPerCrawl: 20maxRequestsPerCrawl: 20 from previous requests. I've tried to do await crawler.teardown();await crawler.teardown(); but to no avail. What's even worse is that for two requests that come in at the same time, the requestHandlerrequestHandler is polluted by the separate calls! How do I isolate instances of CheerioCrawlerCheerioCrawler from each other?
