Ssour-pink
Idealista
I am currently working on a task that involves scraping property listings from Idealista.es, specifically for properties in Barcelona. The main objective is to ensure that all property data is collected, including photos, which the existing Apify actor seems to miss due to a bug.
There are two potential approaches to solving this issue:
Debug and fix the existing Apify actor: This would involve identifying and resolving the bug in the current actor to ensure it captures all photos.
Use the existing actor to scrape data and separately download the photos: This approach might be slightly more complex but would ensure that all photos are collected even if the actor cannot be fully fixed.
A key constraint to consider is that Idealista has a paging limit of 2000 properties per location. Therefore, Barcelona will need to be divided into smaller areas based on their autocomplete suggestions to ensure all properties are captured.
The expected deliverables for this task include a simple database (such as SQLite) containing all the scraped property data and a folder with all the property photos, with references to the photos in the database.
I would appreciate it if you could analyze this problem and suggest the best approach, specifying the tools and technologies you would recommend. Additionally, it would be helpful to have an estimate of the time required to complete the task and the associated costs, including Apify costs.
Thank you for your attention to this matter. I look forward to your insights.
There are two potential approaches to solving this issue:
Debug and fix the existing Apify actor: This would involve identifying and resolving the bug in the current actor to ensure it captures all photos.
Use the existing actor to scrape data and separately download the photos: This approach might be slightly more complex but would ensure that all photos are collected even if the actor cannot be fully fixed.
A key constraint to consider is that Idealista has a paging limit of 2000 properties per location. Therefore, Barcelona will need to be divided into smaller areas based on their autocomplete suggestions to ensure all properties are captured.
The expected deliverables for this task include a simple database (such as SQLite) containing all the scraped property data and a folder with all the property photos, with references to the photos in the database.
I would appreciate it if you could analyze this problem and suggest the best approach, specifying the tools and technologies you would recommend. Additionally, it would be helpful to have an estimate of the time required to complete the task and the associated costs, including Apify costs.
Thank you for your attention to this matter. I look forward to your insights.
This is the official developer community of Apify and Crawlee.
14,091Members
Resources
Recent Announcements
Similar Threads
Was this page helpful?
