Apify & Crawlee

This is the official developer community of Apify and Crawlee.

Join

Apify & Crawlee

This is the official developer community of Apify and Crawlee.

Join

crawlee-js

apify-platform

crawlee-python

💻hire-freelancers

🚀actor-promotion

💫feature-request

💻creators-and-apify

🗣general-chat

🎁giveaways

programming-memes

🌐apify-announcements

🕷crawlee-announcements

👥community

Christopher

6/26/2025

Golf Data..scraping app

i'm working on a project for an individual who works with golf course data. all things related to the course, yardages, tee times, superintendents, slope ratings, etc. older gentlemen has been manually "scraping" data for years. i'm new to the scraping tools, but it sounds like Apify would be a great solution to run and gather all this data automatically. ...

Mariela

6/25/2025

Hello! I am interested in a marketing collaboration.

Hello! I am interested in a marketing collaboration. My suggestion is https://blog.apify.com/what-is-an-anonymous-proxy/ Anchor: brand protection software...

Charlie_DUC

6/24/2025

Max 100 results / capacity limit? How to increase.

Hey guys, loving the platform. I'm on a free 7 day trial and running some successful scrapes of a major UK supermarket's ecommerce store. I want to scrape their whole pet food section but the runs max out at 100 items. Is there something more general in my plan or settings that I need to change to increase that, or is it something specific to that Actor's dev/ my settings there?...

shockwave

6/20/2025

Needed timeout parameter.

I'm scraping google map review. Actor is 'agents/google-maps-reviews'. I must scrape as much as possible, during limited duration(120s). But timeout is critical. I can specify maxItems, but scraping rate is variable, so I can't decide the propriety value of maxItems. It sometimes scraps 2.9 reviews/s and sometimes 6.3 reviews/s. I have upgraded to "Scale plan", but no effect....

Arz

6/17/2025

Apify-HELP

Does anyone know a good option (preferably free, but I don't mind paying a little if it's good) that can extract data? I'm looking for a tool that can search specific websites (ideally 5 of my choice) for job offers and then forward the results to Make.com, which will handle the rest of the workflow. ------
( I want to automatically extract job listings for positions like "Warehouse worker" or "dishwasher" (and so on) from several job websites—let's say four different ones—and send the data to Make.com once a week? Where it will then translate and send it to Outlook module.........)...

Solution:

Hi, as I'm trying to aswer this [here], I'll mark this as completed

Strijdhagen

6/17/2025

Insights page is broken, everyone is now a "free user"

Arz

6/16/2025

Apify Question:

Solution:

Hi, I've tried answering here

!!!Joefree!!! 👑

6/10/2025

BUG: Input Schema "unit" setting not displayed

 "age": {"title": "🕒 Published In", "type": "integer", "description": "💡 If specified, sorting will be set to <code>NEWEST</code>", "unit": "Hours"},

 "age": {"title": "🕒 Published In", "type": "integer", "description": "💡 If specified, sorting will be set to <code>NEWEST</code>", "unit": "Hours"},

hmcguirk

6/10/2025

Logging Best Practices

Hi. I'm working on my first Actor, to understand capabilities of the platform before I build some real Actors. Can someone explain some recommendations around logging? I have my docker container that writes to console. I can see that in Apify so all good. But, for example, if a customer runs my Actor, will they always see exactly the same output I see? I would expect public runs to not include sensitive data, but I would like to see that when I run myself. E.g an exception thrown or error return...

!!!Joefree!!! 👑

6/9/2025

BUG: UnderMaintenance again

I set my actor UnderMaintenance, couple minutes later it reset it self (not undermaintenance)

maybe15

6/8/2025

Literally Cannot Subscribe

Hey guys so im in cyprus right now on holiday trying to subscribe with my card based in south africa i cant change the country on the purchase page so it isnt working as it thinks im based in cyprus any help? i emailed support but got a response from an ai agent basically telling me to just go to subscriptions and pay but thats literally what i cant do...

!!!Joefree!!! 👑

6/5/2025

TypingMind APP

Any tutorial how to connect TypingMind APP https://www.typingmind.com/ with Apify MCP server ?

getdataforme

6/4/2025

There is a permission issues in apify members role.

We checked developer role which has organization permission not set but still the invoice are visible to them. @Saurav Jain @Apify...

getdataforme

6/4/2025

Duplicating actors not working even with owner account.

We are trying to create duplicate of actors but getting permission issues even though I am the owner in the Apify console. Do we need to set some extra permission or pass token even for the owner of the actors?...

Anthony (dev)

6/3/2025

How to get a count per day of runs on my actor

I can see in the insights tab, I get a number of users, revenue / costs, but where do I see the number of runs per day?

!!!Joefree!!! 👑

6/1/2025

Actor Suggestions

For last couple months my "Suggested Actors for you" never changes ... it always about "UPWORK" I really want to see other suggestions ......

Dhrumil

5/31/2025

An example actor which provides guide to how to properly use PPE functionality would be helpful.

Right now, only documentation exist for PPE is https://docs.apify.com/platform/actors/publishing/monetize#pay-per-event-ppe-pricing-model and that has very li'l information about how Apify expects developers to implement PPE. I have tried looking into SDK reference but there is very li'l you can know. e.g. I want to understand whether some event charged successfully or got bounced. How do I know from ChargeResult. Charge result says, eventChargeLimitReached but what's the meaning of it ? Does that mean next event can't be charged or current event couldn't be charged! https://docs.apify.com/sdk/js/reference/interface/ChargeResult...

!!!Joefree!!! 👑

5/30/2025

BUG: Actor Analytics

New analytics page can't handle more than 100 actors

RapidTech1898

5/30/2025

Store image to key-value-store?

Hello - i try to save an png-image to a key-value-store from a https-link using the following code: kvs = await Actor.open_key_value_store(name='my-cool-key-value-store') picLink = "https://rapidtech1898.com/wp-content/uploads/2023/11/openai_dall_created-560x320.png" resp = requests.get(picLink, stream=True)...

Solution:

I think i found the solution - using the following code: picLink = "https://rapidtech1898.com/wp-content/uploads/2023/11/openai_dall_created-560x320.png" resp = requests.get(picLink, stream=True) await kvs.set_value('explicit_image', resp.content, content_type='image/png')...

samwilco

5/30/2025

Actor stops collecting data during job but still runs as "successful"

Hey guys, I'm running this Actor skunkattack/uk-companies-house-scraper---company-and-people It seems that at some random point during a run, the actor is unable to gather data but stil complets the full run as successful. This has happened on multiple runs for me now....

Previous Next