Rebooting/Upgrading old scraping agent for e-commerce catalog data

Hi folks, I am a long-term customer of Apify, we developed some custom agents for ecommerce data catalog scraping in 2019-2020-2021. I have a new series of scrape jobs and potentially a long-term production pipeline I need for ecommerce catalog data and social media data, and need to assess whether the former actors can be used or most likely upgraded.

Lukas Krivka•3/9/23, 5:02 PM

Hi Georgi, nice to see you again.

The old actors should just work but the bigger issue is the websites probably changed. For new development, I recommend either rewriting them to the latest version3 - https://crawlee.dev/docs/upgrading/upgrading-to-v3 or maybe better to start from scratch.

But if the websites didn't change, the actor should work

Upgrading to v3 | Crawlee

This page summarizes most of the breaking changes between Crawlee (v3) and Apify SDK (v2). Crawlee is the spiritual successor to Apify SDK, so we decided to keep the versioning and release Crawlee as v3.

Lukas Krivka•3/9/23, 5:03 PM

If you would like Apify to maintain it for you, hit us on https://apify.com/enterprise

Apify

Apify Enterprise - Fully-customized web scraping and automation sol...

Get a complete end-to-end solution from Apify experts for all your web scraping, data extraction and web automation needs. Apify for Enterprise is a service for innovative companies that understand that having the right data at the right time is the key to success in the digital economy.

uncertain-scarletOP•3/9/23, 6:36 PM

Lukas, great to connect with you and thank you for directing me. Absolutely want to rapidly get the actors upgraded and set up for enterprise production work which is what the ultimate need is. We are looking at catalog product scrapes, as well as social media scraping, as well as periodic refresh (maybe monthly/weekly, but eventually daily) to update the data to the latest (such as pricing, etc.).

uncertain-scarletOP•3/9/23, 6:36 PM

Will reach out from my company credentials for the enterprise solution.

uncertain-scarletOP•3/17/23, 4:22 AM

Lukas, setting up the enterprise account now.

MEE6•3/17/23, 4:22 AM

@Georgi | G2 Global just advanced to level 1! Thanks for your contributions!

Alexey Udovydchenko•3/21/23, 9:35 AM

What kind of social media you need? For meta (Facebook & Instagram) all login-based scraping removed permanently because of legal issues