Apify & Crawlee

This is the official developer community of Apify and Crawlee.

Join

Apify & Crawlee

This is the official developer community of Apify and Crawlee.

Join

crawlee-js

apify-platform

crawlee-python

💻hire-freelancers

🚀actor-promotion

💫feature-request

💻creators-and-apify

🗣general-chat

🎁giveaways

programming-memes

🌐apify-announcements

🕷crawlee-announcements

👥community

adverse-sapphire

11/21/2023

hi can you add a specific date like i

hi can you add a specific date like i want to scrape in group where i search and after search what comes i want to scrape

correct-apricot

11/20/2023

Would be great if the 'Page function'

Would be great if the 'Page function' would have versioning.

correct-apricot

11/20/2023

Adding the ability, globally, to name '

Adding the ability, globally, to name 'runs'. E.g. if i run Google or Yelp, i might do a run for restaurants and a run for hotels. Would help administratively to see what runs i performed and find the correct run again.

exotic-emerald

11/17/2023

Can the TikTok actors scrape the For You

Can the TikTok actors scrape the For You page? If cookies for login is provided even?

genetic-orange

11/14/2023

Help me, please. I don't understand why

Help me, please. I don't understand why if I set up 5000 requests I get a maximum of 906, I'm using an actor Facebook Groups Scraper...

foreign-sapphire

11/14/2023

is there any template to scrape tweeter

is there any template to scrape tweeter twetts date wise.

HonzaS

11/13/2023

Hi, would it be possible to change

Hi, would it be possible to change dataset export xls format to automatically convert columns that are urls to be clickable links? Meaning that customers could just click and not copy paste it to the browser if they want to visit the url.

!!!Joefree!!! 👑

11/13/2023

Good day @Apify#7385 team 👋🏻 . new

Good day @Apify team 👋🏻 . new suggestion of the day: enable actor console to receive file upload as input. The input could be stored in default key-value store as octet/stream name INPUT_FILE.

useful-bronze

9/28/2023

The instructions around setting up

The instructions around setting up Github Actions, whilst very valuable, has some errors / is outdated on a version. Working on getting you guys consolidated feedback with all the suggestions, just need to get it working first. If you have some time, please see https://discord.com/channels/801163717915574323/1156897596011446312 (And thank you)

like-gold

9/16/2023

why does my tiktok scraper stop early

why does my tiktok scraper stop early all the time? run time is 1200 seconds & it keeps stopping at 1-2mins why cant i chat to support? the links are broken...

optimistic-gold

9/12/2023

Hi I am using the Instagram Hashtag

Hi, I am using the Instagram Hashtag Scraper actor and was wondering why Apify does not collect the location tag from posts? I do not see this location in the available metadata after using Apify, was wondering if there was a way to collect it...

!!!Joefree!!! 👑

8/17/2023

Hi team Any plan to add SQL type dataset

Hi team! Any plan to add SQL type dataset storage to apify platform ?

rare-sapphire

8/16/2023

Hi Apify team will make my scraper

Hi Apify team. will make my scraper faster if subscribe to a paid plan? My task is the playwriter crawler to make a simple request. But it takes 1 minute in most cases and rarely takes around 20 seconds.

flat-fuchsia

8/11/2023

Plans and pricing · Apify

Hi Apify team. I had a quick question about how upgrade plans affects the data retention period. By default, the free plan provides a data retention period of 7 days for actor runs, unnamed storage, etc. The documentation online states that upgrading plans can increase the retention limit but I don't see any information about retention periods for each of the respective pricing plans on the pricing page. Can someone please tell me what the periods are for each of the plans beyond free? Thanks! https://apify.com/pricing...

conscious-sapphire

8/8/2023

Google Dataset Items Translator · Apify

Hi Apify team, just a quick comment. I noticed you changed how the Actors are listed and sorted, in a way that I frankly do not quite understand... The way you are sorting the Actors "by relevance" doesn't make to much sense (maybe only to me?) I will explain with an example (Actors chosen randomly): How can this Actor: https://apify.com/hamza.alwan/google-dataset-items-translator (Modified 17 days ago, 1 user, 27 runs, listed on page 3 as I am writing this) be more "relevant" than this one: https://apify.com/epctex/realtor-scraper (Modified 19 hours ago, 458 users, 16.5k runs, listed on page 6). Again, the two actors selected are just random examples, the list goes on... botom line is: Can you enlighten us and explain what "relevance" means for apify? is there a known way to become more relevant? Thanks for your feedback in advance....

genetic-orange

8/7/2023

Dear Apify Team

Dear Apify Team, I hope this message finds you well. I wanted to bring up a feature request that could enhance the user experience on the Apify platform. Currently, when interacting with issue comments, there isn't an option to edit or delete comments once they're posted. This can be a bit inconvenient, especially in cases where a mistake is made or additional information needs to be added after the fact....

fair-rose

7/28/2023

hi there Does APIfy have have a swagger

hi there. Does APIfy have have a swagger or open api spec to generate api clients?

fair-rose

7/9/2023

this has been deleted but is linked as

this has been deleted but is linked as the source code for the instagram scraper. same goes for google

ratty-blush

7/8/2023

Actually it looks like all of the links

Actually, it looks like all of the links under 'How to analyze the error' except for 'named dataset' in item #3 are broken.

ratty-blush

7/7/2023

Source types | Apify Documentation

The documentation for source-types is using a link that doesn't go anywhere–https://docs.apify.com/platform/actors/development/deployment/source-types Discovered by trying to learn more about CI via Github workflow. From my actor's Source -> Code I clicked Github integration in To automatically rebuild your actor on every git push, see GitHub integration. That leads to the link I shared above. On that page, the info about setting up an integration for automatic rebuilds on every commit includes a Github integration link that just links to the current page....

Previous Next