E-commerce Scraping Tool - Add scrapping conditions - Is it possible using the Public Actor Apify
Hello team @Apify , I am helping a friend to build a basic scrapper using the Apify maintain E-commerce Scraping Tool.
I just want to know how or if there is a way to add a Scrapping condition for example. I want to scrap all product listed in a brand category or search result category. Ei: Prada Shoulder Bag - "Condition" only scrap result that have the word Prade and ignor the rest. Is that possible out of the box or do I have to request assistance to build a specific Jason format?
Thank you very much
5 Replies
Asking this question in Actor's "issues" tab would be best.
I see You already did so. So let's just wait for response from the original dev, if there is a way to do it directly in the scraper / do they have in plans to add this feature.
For now I can recomment to post-process you result from the scraper e.q. with this utility actor:
https://apify.com/lukaskrivka/dedup-datasets
e.q. You can loop over final dataset and save only needed items.
But still it means You will spend some resources on scraping items / categories you don't need. So it's an option, but not the best (and might be acceptable if usage of E-commerce actor is cheap for you/you have enough budget).
The problem is the Actor get very expensive quickly when using e-commerce tool with let's say 50 website, so i was trying to find a way to simply ignore items if they don't match the "Condition"
one option would be creating your own scraping logic with https://apify.com/apify/web-scraper
or https://apify.com/apify/cheerio-scraper
or for now let's just wait for response from e-commerce scarping tool devs 🙂
They should appear shortly, I guess 🤓
Thanks @Oleg V. I am hoping to resolve this with low-code or no-code. Basically get the developers to help with my issue. However, yes you are right create my own actor maybe an option, but to be honest it seems difficult.
If you are not familiar with coding. You can also try to find someone in #💻hire-freelancers