Apify & Crawlee

AC

Apify & Crawlee

This is the official developer community of Apify and Crawlee.

Join

crawlee-js

apify-platform

crawlee-python

💻hire-freelancers

🚀actor-promotion

💫feature-request

💻creators-and-apify

🗣general-chat

🎁giveaways

programming-memes

🌐apify-announcements

🕷crawlee-announcements

👥community

vicious-gold
vicious-gold12/2/2023

Hi there,

Hi there, I don't have Paypal account and I have provided my bank details in Different Method type in options of Payment but I have not received the Payment yet....
No description
harsh-harlequin
harsh-harlequin11/19/2023

Hi! I’m curious about making my actor

Hi! I’m curious about making my actor public. Please share your success story! How much have you earned with your actor? ...
flat-fuchsia
flat-fuchsia11/17/2023

gabrielm (Gabriel) · Apify

Hello. Did they change something in the documentation requirements? I have two published scrapers, each one with a big README.md file that AFAIK were OK until some days ago. 😢 But now, the information section appears empty. And from the developer' site, the actors help is shown for a short while and then disappears! Look https://apify.com/gabrielm...
sensitive-blue
sensitive-blue11/16/2023

@Drobnikj#8985 ah found you 🙂 haha 🙂 I

@Deleted User ah found you 🙂 haha 🙂 I am using the GPT Scraper which is Amazing!! But sometimes it just doesn't work as expected. Is it possible to get some help with this please?
sensitive-blue
sensitive-blue11/16/2023

Hi is this where we ask for help with

Hi is this where we ask for help with Actors that aren't working as expecte?
correct-apricot
correct-apricot11/13/2023

hello, can I dm you about an apify issue

hello, can I dm you about an apify issue ?
helpful-purple
helpful-purple11/8/2023

who can help me to write apify scraper

who can help me to write apify scraper script?
rival-black
rival-black10/30/2023

Automatic QAs in Apify Store.

Automatic QAs in Apify Store. Hey @everyone , you know that at the moment what you need for your Actors to pass the automatic QAs, is that the Actor succeeds within 5 minutes with the default (prefilled) input, sort of mimicking a user coming to the Actor and hitting the Start button right away (docs here: https://docs.apify.com/platform/actors/publishing/test). You also know if you have an Actor that needs e.g. credentials, so it is not possible to prefill the correct values, you can ask to be removed from those tests. Now we are closing to a new feature in tests which is also evaluating number of results. Meaning - if the Actor is a scraper, you would expect it to return some results, and we are going to add this to the automatic QA soon(ish). So if you have Actors, that run with the prefilled input but do not return any results and that is correct, please ping me with their IDs (and ideally reasons if it is not obvious) and I will set them a no dataset flag so that once we will switch the new QA on we will all be ready!...
correct-apricot
correct-apricot10/27/2023

how can I unpublish my actor

how can I unpublish my actor

Do you have some best practices for

Do you have some best practices for developing big actors 🤔 I have done a lot of refactoring but I am missing some guidance on this for my actors

Is it possible to send out a notice to

Is it possible to send out a notice to existing customers about any breaking changes due to changes to the code and implementation of the actor?
rival-black
rival-black10/17/2023

everyone We are starting to work on

@everyone We are starting to work on better rating of Actors. At the moment they are mostly ordered by the overall number of users which gives a huge advantage to old Actors no matter the quality. What metrics are in your opinion important for you and your users? Which would you like to show (and which not) and why? We are planning to add some kind of customer rating (github stars/ 1-5 stars/ reviews) as well in the future, but at the moment want to leverage things we already measure anyway. Post in the thread please....

Apify Console

Hello @team. Could we keep a run from disappearing, can we give a "run" a name, so I can include a run as example inside README. example https://console.apify.com/view/runs/GLYwNz2OOdTnTuHK4 A run have nice view about memory and compute unit also dataset sample, But it will gone after couple days.
like-gold
like-gold9/28/2023

Hey I m building multiple actors in one

Hey! I'm building multiple actors in one project. They all share a lot of logic. Is there a recommended way to develop and manage multiple actors in the same project? Right now everything seems centered around the config in .actor and it doesn't seem possible to configure this. Basically the following would solve my problem: * Being able to have multiple actor configs in the same project * Being able to specify entrypoint for each config or have multiple scripts in package.json to start a specific one when developing...
flat-fuchsia
flat-fuchsia9/27/2023

Hello everyone

Hello @everyone, As a developer who has created an actor, I'm looking to implement a subscription model. I've noticed the "Users" count below an actor and I'm wondering if this indicates the number of subscribers for that particular actor, or if it signifies something else? Any insights or advice on setting up a subscription model for my actor would be greatly appreciated. Thank you in advance!...

Hi vladdy VaclavRut Petr Pátek 2496

Hi @vladdy @Nardack @petrpatek. If I need to do api(POST request) scraping using crawlee, how do I do it? Thanks...
flat-fuchsia
flat-fuchsia9/20/2023

Actor settings page is not working

Actor settings page is not working
equal-jade
equal-jade9/14/2023

Hi I got some problem when get clipborad

Hi, I got some problem when get clipborad data in browser, it report permission error. How to solve such problem? Is there any example can be refer. The crawl use playwirght. Any idea are welcome。
flat-fuchsia
flat-fuchsia9/13/2023

Refering to screenshot attached Does

(Refering to screenshot attached) Does this field support json path expressions ? For eg, if i want to access field inside array of objects and output array of strings, can use values like field.*.key ? I have object like this: ``` { ...
No description
rival-black
rival-black9/12/2023

No What would be the use case You can

No. What would be the use case? You can set it for free forever 🙂