Scraper testing
OK, had a look at the documentation and there is one point that is not completely clear to me. Testing. Is there any place where I can find what is the recommended approach to testing scrapers?
In other scraping systems I did, I used to save pages in my project and run tests by using the scrapers with those saved pages.
all within the context of some unit testing library, of course, not just manually running the scraper on the saved page.
In other scraping systems I did, I used to save pages in my project and run tests by using the scrapers with those saved pages.
all within the context of some unit testing library, of course, not just manually running the scraper on the saved page.
