Apify & Crawlee

AC

Apify & Crawlee

This is the official developer community of Apify and Crawlee.

Join

crawlee-js

apify-platform

crawlee-python

💻hire-freelancers

🚀actor-promotion

💫feature-request

💻creators-and-apify

🗣general-chat

🎁giveaways

programming-memes

🌐apify-announcements

🕷crawlee-announcements

👥community

Exporting dataset to RSS escapes HTML tags

Hi, I noticed that HTML tags are escaped in the RSS export of my dataset. Is it possible to avoid this?...
No description

LiveAuctioneers Scraper - use question

Hi! I'm new to Apify, and am trying to export a dataset into a spreadsheet using the LiveAuctioneers scraper (for non-commercial purposes). I enter the search result URL but it only compiles the resulting URLs without pulling any other information—title of artwork, price of sale, image, auction house, etc. Any recommendations on how to effectively use the Scraper? Sorry in advance if I'm missing the obvious answer to that.

npm install apify-cli error, run with apify --version

node:internal/modules/esm/assert:88 throw new ERR_IMPORT_ATTRIBUTE_MISSING(url, 'type', validType); ^ TypeError [ERR_IMPORT_ATTRIBUTE_MISSING]: Module "file:///e:/winAPP/nvm-windows/v22.16.0/node_modules/apify-cli/node_modules/ajv/lib/refs/json-schema-draft-07.json" needs an import attribute of "type: json"...

Maximum platform usage per month

I just got an email saying: Your Maximum platform usage per month custom limit is expiring in 6 days. Please upgrade your plan or contact support. but when I go into "Limits" in my billing console it looks like I'm not even close to my limits. Is there something I should do?
No description

Standby mode parameters

I'm currently working with apify/rag-web-browser in standby mode. The normal actor inputs are working fine (https://apify.com/apify/rag-web-browser/input-schema), but the standby parameters (https://apify.com/apify/rag-web-browser/standby) are not accepted. I can't create issues on the Actor page (says I must request write permission with no instructions on how to do that). Am I misunderstanding those parameters? Can they not be sent in a request? Is this issue specific to the Actor, or are the standby endpoints a platform thing?...

How to manually delete a record from key-value-store (using Apify console)

I am logged into Apify console and trying to delete some unwanted data records from a key-value-store. I can see how to view or download the files, but I can't see how to delete them (other than by deleting the entire KVS). Am I missing something?...

Actor running at negative profit margin, need cost breakdown guidance

I got an email today saying my Actor (shashankms2580/google-ads-transparency-scraper) is running at a negative profit margin (-91.6%). Revenue: $4.40 Cost: $8.43 Deficit: -$12.46 ...

Store Ranking Algorithm

Hey folks, Can you please help me to understand how the Apify store ranking algorithm works and what I can do to optimise things? In particular, I was under the impression that I would gain a significant ranking boost by using tiered pricing, as per @ellativity's announcement on 13 August:...

Resurect an Actor run

I develop an actor that runs on Apify platform. The actor will basically take a list of URL in the INPUT and open each one of them. Simple. I run the Actor and it timed out. Fine. Then I resurrected it and strangely enough, it started loading the INPUT list of URL from the begining. Isn't it strange ?...

E-commerce Scraping Tool - Add scrapping conditions - Is it possible using the Public Actor Apify

Hello team @Apify , I am helping a friend to build a basic scrapper using the Apify maintain E-commerce Scraping Tool. I just want to know how or if there is a way to add a Scrapping condition for example. I want to scrap all product listed in a brand category or search result category. Ei: Prada Shoulder Bag - "Condition" only scrap result that have the word Prade and ignor the rest. Is that possible out of the box or do I have to request assistance to build a specific Jason format? Thank you very much...

README not Updating

The Readme in the "information" section is not updating but the source code there isn't aswell but in the "Source" Section in "Code" it is updated

DeepScarper feature of LinkedIn Sales Navigator Scraper

Hello, I'm using the LinkedIn Sales Navigator Scraper. But I don't know why the DeepScarper feature isn't working. It used to work fine, but now it doesn't. I enabled the DeepScraper switch in the platform, but it still doesn't work. ...

No Results - so stressful

Hello, I don't know why I'm getting " No results" from any Actors. Even my limit is still full...

Actor can not be publish Error.

I have build one scraper. I have tested it on Apify as well and its working fine. Right now it is private. But when I am trying to make it public, I am facing this Error. can someone help?...
No description

MCP Chat fails silently

I tried this query "find me personal trainers in NYC on instagram" on the MCP chat at https://mcp.apify.com/chat and it simply failed silently with no feedback of any kind. I tried configuring actors but nothing worked. lease let me know what I am doing wrong with my query or configuration

How to add to code limits for free plan?

I've noticed that my public app in the apify app store has a huge amount of usage from free plan users and the revenue is in the high tens of dollars negative. Can anyone point me in the direction on how to limit the free plan users for example to 100 outputs per run? thanks!

Creator plan proxy limits issue

Hi there, I am on the creator plan. I just received an email saying that I've reached the limit of my plan and actors will stop working, but the current usage is just $11, I am only using my own actor and datacenter proxies. Most of the usage is for the proxies. Can you please help?...

Paypal dispute

Hey guys actually due to typo my money was send to someone else can someone pls tell me how can i raise dispute and take my money back i talk to PayPal team they asked to ask apify as you guys can raise the dispute and send to rightful person as i already fix my account Org: Createathon createathon@persistventures.com ...

Affiliate program.

I'm trying to use the affiliate program, i make ads on multiple places, on the affiliate dashboard it counts the clicks, but i dont seen to get any referrals to earn some extra money. Does the affiliate program works? I see it is on beta or something. I'm using the link: https://apify.com/songd/1688-search-scraper?fpr=uvhb52&utm_source=reddit...

🚩 Fake review abuse on our new scraper shows platform needs better safeguards

Yesterday we released our new Semrush Scraper. Within hours, a competitor (as we know now, having investigated it ourselves) used multiple fake accounts to leave more than ten 1-star reviews. Some of the accounts ran the scraper once with deliberately invalid inputs, others didn’t run it at all (more reviews than actual users) and just posted “not working.” or similar reviews to manipulate the public image of our actor and in the end also on our reputation. As a result the rating for this actor dropped significantly on the first day of launch, even though the scraper works as expected. This shows clear weaknesses in the review system. At the moment, there are 3 key weakness that we would like to point out: - Users can leave a review without ever running an Actor - Brand-new accounts can post reviews immediately (primarily free accounts)...
No description