instant-harlequinI

Is it better to separate scraper by domains?

I have about 10 different domains that I want to crawl. Each one of those domain has:
- List view
- Detail view

Is it better to separate those scrapers? I don't need high concurrency. This is a low workload. But how does the route handler look like?
Was this page helpful?