exclude start URL
Hey All,
There was nothing here when I searched this phrase.
I have a bunch of sites where the Glob format of the links to be scraped is the Start URL plus something like /// - Is there some easy way that I just don't see to exclude the StartURLs from being scraped? They produce junk data, as you can imagine. Thanks!
There was nothing here when I searched this phrase.
I have a bunch of sites where the Glob format of the links to be scraped is the Start URL plus something like /// - Is there some easy way that I just don't see to exclude the StartURLs from being scraped? They produce junk data, as you can imagine. Thanks!
