Apify Question:
Does anyone know a good option (preferably free, but I don't mind paying a little if it's good) that can extract data?
I'm looking for a tool that can search specific websites (ideally 5 of my choice) for job offers and then forward the results to Make.com, which will handle the rest of the workflow.
40 Replies
Does anyone know a good option (preferably free, but I don't mind paying a little if it's good) that can extract data?
I'm looking for a tool that can search specific websites (ideally 5 of my choice) for job offers and then forward the results to Make.com, which will handle the rest of the workflow.
Depends on what you want to scrape - if there is not too much anti-automation security, you can try with apify/website-content-crawler. It should be easy to integrate with Make (see Apifys and Makes relevant documentation.
Make integration | Platform | Apify Documentation
Learn how to integrate your Apify Actors with Make.
Apify - Apps Documentation
Apps Documentation
What if I want to automatically extract job listings for positions like "Warehouse worker" or "dishwasher" (and so on) from several job websites—let's say four different ones—and send the data to Make.com once a week? Where it will then translate and send it to Outlook module.........
Looking at different job scraping actors (I just searched "job" on Apify Store ) it seems like they in general supports searching for something specific like "Warehouse worker". For the integration with Make, you can either use the trigger "Watch Task Runs" and schedule a task, or trigger the runs from make with the "Run a Task" and schedule you scenario
Schedules | Platform | Apify Documentation
Learn how to automatically start your Actor and task runs and the basics of cron expressions. Set up and manage your schedules from Apify Console or via API.
Schedule a scenario - Help Center
Help Center
But schould i still use this "apify/website-content-crawler.", because these Jobs - sites use a lot of anti bot measurers...
Probably not no, I'd say that the specific scrapers are more likely work for you 😌
specific sites scraper will only work because every website has different layout
so you mean i schuld let someone create a Specific seite for me right? with Apify
But how does it exactly work? Can i for axample create this specific Site, and use it without having to pay the Apify - Subscription? Lets say for example i have compleated this Webseite, do i have to make it public, if not, what are the the advanteges of making it public and not making it Public? And do People usally Charge Money on theyre Sites?
I can"t understand what you mean by specific site. I think you meant scraper? right
yes
yes, thats what i meant
yes, thats what i meant
So do you maybe know the Answer: But how does it exactly work? Can i for axample create this specific Scrapper, and use it without having to pay the Apify - Subscription? Lets say for example i have compleated this Scrapper myself, do i have to make it public, if not, what are the the advanteges of making it public and not making it Public? And do People usally Charge Money on theyre Scraper, if not why dont they?
Like lets say i compleated this Scrapper, and not want to use it, do i have to like pay a lilte bit money to Apify or can i use my own Scrapper for free? Do you know?
yes
So, If you make the scraper public other users can use it and hopefully you can earn.
if your scraping less often then apify free credit can cover.Apify provides resource to host your actor and also for proxy. You can host yourself if you are planning to use for personal needs
but does this Option cost me money? I am new to Apify and in scrapping in General. So lets say that i will only Srape once and make this Scrapper for the project, after that i will stop, SO do i still have to pay Apify anything. I didnt quite Understand you Answer...
If you dont scrape, it wont cost you money
But only if theres an actor present on apify, if not you would have to either create one or ask someone for it(mostly people would charge for it). hope that helps, if not feel free to ask your doubts
But if i scrape four Webseite mayself, for my Private use. Will i then get charged from Apify for basically using thyre Webseite to scrape?
And if lets say i decide to make the scrapper avaliablke for everyone. Will i have to pay then Apify some percentage or pay for like hosting? And another question: Will if effect the maintance, like for example if it will make these Webseite i scrapped add more securty layers? Or so? Do you understand how i mean it.....
If you use for private needs its fine but you need to pay apify because you will be using their resourve and platform
If you make it public people can use it and if they are paid plan you will earn through it.
and thiers nothing as website will increase security layer
and thier are lot of spelling mistake which make it hard to understand your context
But if I make it public, will I still need to pay for the Apify subscription, or is it free then?
My only question is: do I have to pay in both scenarios? One where I make the scraper public, and the other where I keep it private. That’s all I want to know.
@Arz just advanced to level 3! Thanks for your contributions! 🎉
I dont Understand: and thiers nothing as website will increase security layer
Yes, in both scenarios you need to pay, because when you will run the actor it will run on apify infrastructure so thats what you are charged for
Hoow much would that cost me in both scenarios?
Do you mabe know?
it depends how much resource you use
while running the actor, if proxy used then more and etc
What if i scrape 4 differet webseite, , and then i like add it with n8n or Make.com
yeah you can integrate make and n8n with apify
but how much would that cost? With everything i want to do......
are you making the actor on your own?
i think, dont know yet
so an estimate for myself
I didnt get your point, are you asking how much it would cost to run on apify or to build the actors?
both
How many actors you want to be built?
@thenetaji just advanced to level 7! Thanks for your contributions! 🎉
I think four, because I’ll be scraping four JOBS - websites
How much you are willing to pay?
dont kow, first tell me your estimate
depends on site complexity and time required and is it highly protected or not
so can you send me website link to check
What would you say about these: https://www.suedtirolerjobs.it/?utm_source=google-ads&utm_medium=cpc&utm_campaign=google-ads&gad_source=1&gad_campaignid=19771683310&gclid=Cj0KCQjw1JjDBhDjARIsABlM2Svz_7Vnx_qMmgsKOSUgS5sFULOZ0w7LqISgeTYe1wLEkOqCL9zWz80aApqYEALw_wcB or: https://karriere-suedtirol.com/?gad_source=1&gad_campaignid=11804879700&gclid=Cj0KCQjw1JjDBhDjARIsABlM2SvOT51C6CaiQ049T6K2klptgM70T41aQPrJLYdCPrcXweC4Jnqg4W4aAqflEALw_wcB OR https://www.joobz.it/
Jobs & Stellenangebote in Südtirol - Karriere Südtirol
Jobs in Südtirol ♥ Alle Stellenangebote von Südtirols Top-Unternehmen ✓ Finde Deine Arbeit mit Karriere Südtirol ♥ der Jobbörse für Südtirol.
Stellenangebote und Jobs in Südtirol: joobz.it
Unternehmen, Stellenangebote und Jobs in Südtirol? Das alles und mehr findest du auf joobz.it. Die andere Jobbörse für Südtirol.
please wait a few minutes, I am checking...
Ok
hey, looks the site are not much protected, only thing required would be time to build, and format the data in a cleaned version. Can you just tell me your budget, and If you are okay, I will be happy to do this project, if you consider
ok, let me think about it, dont know yet...
sure, take your time