AC

Apify & Crawlee

This is the official developer community of Apify and Crawlee.

AC

Apify & Crawlee

This is the official developer community of Apify and Crawlee.

crawlee-js

apify-platform

crawlee-python

💻hire-freelancers

🚀actor-promotion

💫feature-request

💻creators-and-apify

🗣general-chat

🎁giveaways

programming-memes

🌐apify-announcements

🕷crawlee-announcements

👥community

10/13/2025

:python: :crawlee: **Crawlee for Python webinar: Wednesday 15 October 2025** :crawlee: :python:

:python: :crawlee: Crawlee for Python webinar: Wednesday 15 October 2025 :crawlee: :python: Hello all! Following the launch of Crawlee for Python v1.0, we wanted to take some time to showcase the new features for you. 🎉 Join us for a webinar and Q&A on the new Creators' Stage here in Discord at 9AM EST // 1PM GMT // 3PM CEST // 6:30PM IST - I will be your host, so I'm hoping to meet some of you there!...

9/30/2025

:python: :crawlee: **Crawlee for Python v1.0 is here!** :crawlee: :python:

:python: :crawlee: Crawlee for Python v1.0 is here! :crawlee: :python: We have moved Crawlee for Python out of beta 🎉 With some brand-new features and updates across the board, we believe that this version of Crawlee for Python is the one you’ve been waiting for. :crabparty: ...

3/24/2025

Crawlee for Python v0.6 is OUT 🎉 @everyone

Crawlee for Python v0.6 is OUT 🎉 @everyone The long-awaited feature of Adaptive Crawling, which gives the crawler power to opt for static or browser-based crawler based on the page is here. It also integrates browserforge to enable fingerprint generation in PlaywrightCrawler....

3/18/2025

Call for feedback on Crawlee for Python @everyone [Win 5 Scale plans for a month and exclusive Crawl

Call for feedback on Crawlee for Python @everyone [Win 5 Scale plans for a month and exclusive Crawlee goodies] 🎁 @Public actor developer Hey everyone 👋 We launched Crawlee for Python around this time last year. Since then, we've received tremendous positive responses from our developer community, along with valuable suggestions that have helped us enhance the platform even further....

10/10/2024

Optimizing web scraping: Scraping auth data using JSDOM @here

Optimizing web scraping: Scraping auth data using JSDOM @here This article discusses a new approach that we use in one of our Actors to obtain the authentication data from TikTok ads creative center generated by browser web applications without actually running the browser but instead of it, using JSDOM. 🔗 https://dev.to/crawlee/optimizing-web-scraping-scraping-auth-data-using-jsdom-3cji...

9/23/2024

Hello @everyone 👋

Hello @everyone 👋 Crawlee is just 7 stars away from 15000 ⭐ on GitHub. 🔥 Let's make it to the goal today and we will announce a exciting giveaway soon. 🤩 ...

8/28/2024

**Learn how to build scrapers that can scrape infinite scroll web pages using Crawlee for Python**.

Learn how to build scrapers that can scrape infinite scroll web pages using Crawlee for Python. :crawlee: :python: @everyone We have written a step by step tutorial to explain how to scrape infinite scroll websites using Crawlee for Python from installation to exporting data to CSV, it explains everything. 🚀 https://crawlee.dev/blog/infinite-scroll-using-python...

8/5/2024

We have started @here

We have started @here https://www.youtube.com/live/ip8Ii0eLfRY?si=-E4Ml3aC58zlZrcS...

8/5/2024

**Happening Today: Introducing Crawlee for Python Live Webinar with the creators of Crawlee** @here

Happening Today: Introducing Crawlee for Python Live Webinar with the creators of Crawlee @here 🚀 After successful launch of Crawlee for Python, and demand of our community we are doing a live webinar talking about library, giving you a live coding demo, as well as to answers questions of all the developers. :crawlee: ...

7/29/2024

Crawlee for Python live webinar with the creators of library! @everyone 🚀

Crawlee for Python live webinar with the creators of library! @everyone 🚀 After successful launch of Crawlee for Python, and demand of our community we are doing a live webinar talking about library, giving you a live coding demo, as well as to answers questions of all the developers. :crawlee: Join us for an engaging webinar on August 5th, 2024 at 9 AM EST...

7/23/2024

**Apify had a booth at EuroPython 2024 in ** **Prague!** 🐍 @here

Apify had a booth at EuroPython 2024 in Prague! 🐍 @here Crawlee for Python was launched just a day before the conference, so we were thrilled to share the open-source web scraping and automation library directly with its core audience: Python developers 🧑‍💻 We met some wonderful people who were excited about the library, gave us instant feedback, starred it on GitHub, and then went on to explore the Apify platform 🤖...

No description

7/9/2024

**Crawlee for Python is LIVE** @everyone 🎉

Crawlee for Python is LIVE @everyone 🎉 After the continuous feedback from our developer community to build Crawlee for Python community. Our team worked very hard and put this to life. 🐍 ...

6/19/2024

**Adaptive Crawling Updates** @everyone 📢 :crawlee:

Adaptive Crawling Updates @everyone 📢 :crawlee: - We now support parseWithCheerio and waitForSelector helper in AdaptiveCrawler (code snippet attached) - Common interface for browsers and Cheerio 🖥️ - Also in the latest release there are a lot of fixes in the existing stuff to make things even better. 💯 ...

No description

6/12/2024

@everyone Join me and @B4nan today live at 3 PM CEST talking about:

@everyone Join me and @B4nan today live at 3 PM CEST talking about: - How to scrape in JavaScript and TypeScript - Crawlee Library - Features like Adaptive Crawling and Tiered Proxies...

6/7/2024

Scraping with Crawlee 101 :crawlee: @everyone ( 5 days to left)

Scraping with Crawlee 101 :crawlee: @everyone ( 5 days to left) Join our webinar on June 12th at 9 AM EST to learn how to scrape any website using Crawlee in JavaScript/TypeScript. Discover the modern features and all of Crawlee's capabilities, from working with JavaScript-rendered websites to its latest adaptive crawling feature....

5/20/2024

Crawlee is trending on GitHub TypeScript section today :crawlee: @here

Crawlee is trending on GitHub TypeScript section today :crawlee: @here Best time to star Crawlee if you haven't already! :Star: https://github.com/apify/crawlee...

5/16/2024

On the demand of our developer community, we have done a comparison between Scrapy and Crawlee. :cra

On the demand of our developer community, we have done a comparison between Scrapy and Crawlee. :crawlee: @here It covers many important topics like autoscaling, headless browsers, proxy management, etc. 💯 It should clear your doubts regarding choosing which library for your use case. ...

4/10/2024

**Crawlee Web Scraping Tutorial** @here

Crawlee Web Scraping Tutorial @here Build a HackerNews scraper using Crawlee :crawlee: https://blog.apify.com/crawlee-web-scraping-tutorial/...

4/2/2024

**How to Scrape Amazon Products using TypeScript, Cheerio, and Crawlee**

How to Scrape Amazon Products using TypeScript, Cheerio, and Crawlee New blog @everyone 📢 Learn how to scrape amazon products using Crawlee through this step by step guide.:crawlee: ...

2/28/2024

It's been a long time coming, but it's finally here! 🎉 @everyone

It's been a long time coming, but it's finally here! 🎉 @everyone We're excited to launch Crawlee Blog, a resource hub for every Node.js enthusiast who wants to explore the field of web scraping and crawling. 💯 Learn more about our plans for world domination here: https://crawlee.dev/blog/crawlee-blog-launch...