Apify & Crawlee

AC

Apify & Crawlee

This is the official developer community of Apify and Crawlee.

Join

crawlee-js

apify-platform

crawlee-python

๐Ÿ’ปhire-freelancers

๐Ÿš€actor-promotion

๐Ÿ’ซfeature-request

๐Ÿ’ปcreators-and-apify

๐Ÿ—ฃgeneral-chat

๐ŸŽgiveaways

programming-memes

๐ŸŒapify-announcements

๐Ÿ•ทcrawlee-announcements

๐Ÿ‘ฅcommunity

Actor stops collecting data during job but still runs as "successful"

Hey guys, I'm running this Actor skunkattack/uk-companies-house-scraper---company-and-people It seems that at some random point during a run, the actor is unable to gather data but stil complets the full run as successful. This has happened on multiple runs for me now....
No description

where did the actors stats div go? (containing paid users, free users, success % etc)

where did the actors stats div go? (containing paid users, free users, success % etc)

Writing pdf / jpeg / zip to key-value-store?

Hello - i would like to store a file like pdf / image / zip in a key-value-store - I can open the key-value-store with: kvs = await Actor.open_key_value_store(name='my-cool-key-value-store') ...
Solution:
I think this is a list about the possible MIME Types: https://developer.mozilla.org/en-US/docs/Web/HTTP/Guides/MIME_types/Common_types...

How to create PPE plan which is hybrid of both. Minimum monthly commitment + Overuse

How to implement following pricing model using PPE ? - I want to charge fixed monthly 50 USD per month if customer has used actor atleast once a month. - Along with 50 USD onetime charge, I am glad to offer 1000 free dataset items - Above 1000 dataset free items, I would like to charge 1 USD per extra dataset write....

BUG? ACTOR_MAX_PAID_DATASET_ITEMS

why when re-rerun (ressurect) a run, the ACTOR_MAX_PAID_DATASET_ITEMS changed to very big number ?
No description

Debugging with keystroke using async actor?

Hello - im am testing with the basic template for python: https://apify.com/templates/python-start For debugging reasons i would like to output every heading and then waiting for a keystrike using <input("Press")> using the following code code below. ...

Running actgor with different input-parameter?

Hello, i tired the following template for python: https://apify.com/templates/python-selenium worked generally fine. But how can i run the actor with different urls?...
Solution:
storage > key value storage > INPUT.json There you can provide the inputs to your actor. More info here: https://docs.apify.com/academy/deploying-your-code/inputs-outputs...

About Timestamp in Dataset

I just noticed something. When we have timestamp data in the dataset, the console dataset viewer automatically displays it in the current (browser) timezone. Is this correct? Just want to confirm.
No description

Error when running basic example from documentation

I try to run the example from this page: https://docs.apify.com/sdk/python/docs/overview/running-actors-locally Created this: apify create my-first-actor --template python-start...
Solution:
Have you tried running apify run --purge...

Under Maintenance

Suddenly all my actor gone Under maintenance. But I didn't change anything, Wonder what happen ?
No description

Apify MCP memory parameter

Hello, trying to build prototypes using MastraAI and MCP servers. I was able to successfully integrate via stdio, but am lacking the possibility to either instruct agent or set in env the amount of memory actor run should take. It will help me overcome my memory usage limits. Is there such possibility and I am overlooking it, or is there planned st like that? Thanks

Authentication Cookies via API

Hello everyone! ๐Ÿ‘‹ I'm developing an application and exploring options to automate access to websites that require login, primarily news sites with paywalls. I'm looking for a hosted solution that enables me to: Open a browser session via API...

Social Mmedia Influencer Scraper

Hello, I am new to the Apify. I am trying to integrate influencer scraper to N8N. Even, I change the keywords, search result is same. I am not sure what the reason is......

No views count

The Instagram actor is currently not scraping the Reels view count. Please check and let me know if any update is required

Default inputs for run screen vs. API

Is there a way to set a default input JSON or default field value in the actor IF the actor is being run from within Apify run screen vs. API?

How are request queue writes calculated?

I ran the cheerio scraper on a single page, but the Storage => Request queue tab said Name Unnamed Total...

How to use Apify Proxy with NodeJS Fetch API in an actor for non-browser data collection?

Iโ€™m building an Apify actor where I first populate userData with data from an external API (using fetch) and then make browser requests. How do I configure Apify Proxy for both stages to use the same proxies and ensure data consistency? ```js const options: RequestOptions = { url: url,...

Subscription refund

Hello. Unfortunately, I no longer need apify's power for the near future, but unfortunately I did not cancel my subscription plan and was charged $59, while I am sure that I will not use apify for the next month. This amount is quite significant for me and I really would not like to lose it. Can you initiate a refund and cancel my subscription? It was renewed just a few hours ago and not a single dollar was spent from the account I really hope for your support, thank you...

Question on PPR Actor

Should the PPR actor results go in the default dataset, or can they be saved elsewhere? Since this is a monetized actor, will I still receive income if the data is stored outside the default dataset?
No description