[URGENT] Need Help: Bulk Scraping 1,960 Sites by Dec 8
Hi Apify Community,
I need to scrape 1,960 German websites by Sunday December 8, 2024 and I'm running out of time. Looking for an experienced Apify developer who can help.
Project Requirements:
Use Apify Website Content Crawler (or custom actor)
Extract from 1,960 German (.de) websites
Data needed: Full HTML (JS-rendered), text, headings, links, meta tags
Regex keyword matching against provided keyword list
Export to CSV with specific columns Timeline:
Start: Immediately (today)
Deadline: Sunday Dec 8, 11:59 PM (4 days)
What I'll provide:
CSV file with 1,960 URLs
List of keywords for regex matching
Apify account access (or you can use your own)
Clear requirements document
Who I'm looking for:
Experience with Website Content Crawler actor
Has handled bulk scraping (500+ sites) before
Can work fast and deliver on time
Sample URLs:
https://abq-rems-murr.de
https://accadis.com
https://accumulative.de
If you're interested and can commit to this timeline, please reply with:
Your Apify experience level
Similar projects you've done
Your fixed price quote
Confirmation you can finish by Dec 8
Time is critical - please only reply if you can truly deliver.
Thank you!"
ABQ Rems-Murr GmbH
Gebäudereinigung und Hauswirtschaft | ABQ Rems-Murr gGmbH
Die ABQ aus Winnenden bietet Unterhaltsreinigung, Fensterreinigung sowie Service in Kantinen, Schul-Mensen oder Seniorenheimen im Rems-Murr-Kreis.
accadis Hochschule Bad Homburg | Private Hochschule fĂĽr Management...
Private staatlich anerkannte Fachhochschule für internationale Management-Studiengänge (Bachelor, Master und Promotion) in verschiedenen Studienformen (Vollzeit, Dual, berufsbegleitend)
3 Replies
Hi, you can try my pattern scraper light
https://apify.com/xmiso_scrapers/pattern-scraper-light
scrapes list of URLs for patterns you set, 2000 urls is 5 minute job.
Hi Phil91,
If your goal is to extract information from different websites,
You can use my AI Lead Extractor, which works on any website and can extract whatever data you need using simple AI instructions:
👉 https://apify.com/dz_omar/ai-lead-extractor
Just paste the website URL and tell the AI what you want, for example:
“Extract all emails and phone numbers”
“Summarize the page in 3 bullet points”
“Get company names, contacts, and social links”
“Find all real estate listings and their prices”
The actor will scrape the page and the AI will extract exactly the information you request — fully automated.
So if you're working with multiple websites or custom data needs, this is the best option.
Let me know what kind of data you want to extract and I can guide you.
Best regards,
Omar
Apify
AI Contact Extractor & Web Data Intelligence · Apify
Extract emails, phones, contacts & custom data using AI. Free regex extraction or paid AI-powered dynamic extraction. Natural language instructions.
Hi, I can help you