brilliant-limeB

BasicCrawler request information

Hi, when using BasicCrawler, how do you get info about Hostname, IP Address, User Agent, AS Number for the request, i need to provide them to our client to be able to give us access to be able to scrape
Was this page helpful?