Mmanagerial-maroon
Adapting apify for Crawling
Hi I need some assistance adapting some of the actors for my Crawler
Details: my company has a Crawler Java application that crawls 70-100 sites for review data and currently we need to outsource this application functionality to a 3rd party. This engine handles http, api and standard html download , I want actors that can handle these 3 usecase scenarios. My application handles orchestration, download and parsing , we can still handle the parsing phase of the collected chunks and extract the target data internally but we need the orchestration and download phases handled externally. Is this something you can help with ? If so, I have more questions and I need to speak to some one from Apify implementation before going any further
Details: my company has a Crawler Java application that crawls 70-100 sites for review data and currently we need to outsource this application functionality to a 3rd party. This engine handles http, api and standard html download , I want actors that can handle these 3 usecase scenarios. My application handles orchestration, download and parsing , we can still handle the parsing phase of the collected chunks and extract the target data internally but we need the orchestration and download phases handled externally. Is this something you can help with ? If so, I have more questions and I need to speak to some one from Apify implementation before going any further
This is the official developer community of Apify and Crawlee.
14,091Members
Resources
Recent Announcements
Similar Threads
Was this page helpful?
