Apify & Crawlee

AC

Apify & Crawlee

This is the official developer community of Apify and Crawlee.

Join

crawlee-js

apify-platform

crawlee-python

💻hire-freelancers

🚀actor-promotion

💫feature-request

💻creators-and-apify

🗣general-chat

🎁giveaways

programming-memes

🌐apify-announcements

🕷crawlee-announcements

👥community

Payment issues

Dear Apify-team, I can´t buy the bronce subsription. I´m purchasing with my brasilian company, but my IP is from germany. Im currently visiting my family, thats why I´m physically in germany. Please help me.

Docker builds failing

I see I now have two actors with builds failing in the same way every time. One has literally no changes since the last successful build 12h ago. The other had a few minor changes, all since reverted. Both pass all Dockerfile steps, but fail at: ACTOR: Pushing Docker image to repository. ACTOR: Error: Docker image build failed: NotFound: content digest sha256:......... Is there a known issue?...
Solution:
Switching to a different image in my Dockerfile seems to allow the build to work again

Pay-per-event pricing displaying 1000x higher than actual cost

Hi there, All actors using pay-per-event pricing are showing prices that are 1000x higher than the actual cost in the Apify Store UI (in the Console not on Apify.com). This makes every pay-per-event actor appear drastically overpriced to users. This has been ongoing for 3+ days at least. This is blocking new user acquisition platform-wide and needs immediate emergency fix. Every hour this persists costs developers and Apify significant revenue....
No description

PPE charging API

Hi. I've developed an integration Actor, im trying now to get PPE charging working. Even though ive configured monetization with a single "pay per event" active, when my actor is triggered, i notice the 1) the run input's pricingInfo.pricingModel is "PRICE_PER_DATASET_ITEM". I was expecting "PAY_PER_EVENT". And 2) im getting "operation is not allowed" error from the charging call. Suggestions?
Solution:
I updated my actor to take the RunID from the ACTOR_RUN_ID environment variable (which is correct). Now the 'charge' API call is returning success 👍 . Next, where else can I get the pricing info, so I can get the configured "max charge per run" 🤔

Chrome Extensions

Hi there, I am currently running and maintaining 40 all-inclusive scraper chrome extensions that scrape specific websites. I was wondering if it is possible to package them into headful Apify Actors each and sell access to them.

Uploading Profile image of Actor using API

Curios if we can upload the profile image and update the actor using API?

Apify Creator Plan Usage Problem

Hi, we are using apify's creator plan where we get 85$ of free usage for 6 months with a total of 500$. Currently we surpassed 25$ for 15 jul - 15 aug period and the platform promts me You have used up all of your prepaid usage. Anything over the plan limit will be charged as overage. and when I go to Billing section I get an overage of 7.92$ and where the site says When you run out of prepaid usage, any extra usage will be charged as overage. But we did not exceed 85$ of usage. Is this so...
No description

Analytics Suggestion

Below 'User Runs', also add a 'Failed Test Runs' section to list any test runs that failed, so developers can take action immediately.
No description

BUG ? : input_schema.json

whats wrong with this : ``` { "title": "",...
No description

Pay per event doesn't seem to work 😬

Hi guys! Is there a reason why my actor is setup as "Pay per event", yet the usage data always shows "compute items", e.g.: ```...

UI Suggestion

‘All Fields’ should be placed first to avoid confusion, so that users see it before other options.
No description

Was on Creator Plan, Paid an Invoice for Starter plan but its not getting activated

Hey, I paid for the starter plan at the start of usage and after the month my card didn't have balance for starter plan so the invoice wasn't paid for this month.. I tried the creator plan in between. Creator plan did not help for my use case. So I paid the invoice for the regular Starter plan thinking the subscription will get activated for regular but then the subscription did not get activated and I was still in creator plan so I permanently removed the creator plan but I still have free plan instead of regular plan. production is affected because of this and I would appreciate any quick support please...

Apify MCP server

Hi everyone, I'm currently try to use Apify MCP. The doc doesn't make it clear how I can use it to call one of my previous rented actor. E.g I rented actor A. But from examining list tools of the MCP, it only return default tools 📡 Connected to MCP server...

What is the best and sensible way to change PPE pricing

One of the problem with PPE pricing is that pricing is tightly coupled with code. It's good feature and gives developer a control to specify what to charge for precisely! However, it's a problem when it comes to changing the pricing of PPE. Apify as a platform, doesn't allow pricing to be changed immediately (even for PPE actors). With rental it was ok. Because Apify just provides date on which new rental will be effective. Developer can continue focusing on any upgrades meanwhile without worrying about versions and syncing. With PPE, I have new pricing logic ready in the code but I can't take away old pricing immediately! At the same time syncing with the date Apify provides for new pricing to be effective is tricky part to perform exactly when!...

Users don't want to receive Actors notifications/emails

Hello, I've got some users replying to some actor's notifications, they no longer want to receive them but looking at the mail, looks like there's no option to unsubscribe....

PPR analytic

Last month, I changed the pricing for two of my Actors to Pay Per Result (PPR). However, when I checked the analytics, it still shows a number of free users and zero paying users. I’m confused as to how there are still free users accessing the Actor under the new PPR pricing. Where are these free users coming from? Could please help clarify this? Thank you!...
Solution:
I thought with PPR, I would still earn profit from every run, even from free users. So I removed the data limit setting — but I guess I should reapply the limit for free users?
No description

Fix broken links in the Apify sdk versions documentation page

Documentations' links are all broken (notice the undefined keyword when you hover on any of them - bottom left of attached screenshot). Also release notes links point to 404
No description

Help using apify proxy without sdk

I'm trying to use apify proxys without sdk, using my own framework. But i keep getting Proxy Authentication Required errors. ```golang func NewApifyProxyClientFromEnv() (*ApifyProxyClient, error) { hostname := os.Getenv("APIFY_PROXY_HOSTNAME") port := os.Getenv("APIFY_PROXY_PORT")...
Solution:
never mind, i've just realized i was getting a 407 proxy error and i've fixed it and now it is 403, the apify datacenter proxy does not work with the site

Actor Development

Hey there, I just reverse-engineered the API of a big e-commerce giant because scraping was totally impossible from their website due to hard blockades by captchas and a very sophisticated bot system by their developer team(Hats off to them). I had a look at Apify and found out it is not available here, so I am here to find out how I can become an actor developer. What is the procedure? How can I change my already written Python code to act as an actor? and what about the commission, etc? Thanks and nice to meet you to guys Mujeeb...