crawlee-js
apify-platform
crawlee-python
💻hire-freelancers
🚀actor-promotion
💫feature-request
💻creators-and-apify
🗣general-chat
🎁giveaways
programming-memes
🌐apify-announcements
🕷crawlee-announcements
👥community
Cheap Google Search Results Scraper · Ap...
Hey guys, I want to know how to promote my api actor. I made a very very cheap Google Search API, 1000/0.6U, https://apify.com/tuningsearch/cheap-google-search-results-scraper
hello everyone, Im stuck. Automatic
hello everyone, Im stuck. Automatic tests change my actors status as "Under Maintenance" because of that "prefilled input schema and expect them to succeed within 5 minutes". However, when I test my actor with default input schema example Im getting a response in 6 seconds. Could anyone help me? Im new on apify
Ok but how do I set them in the code if
Ok but how do I set them in the code if they are not variables?
@thenetaji How about through API, do
@thenetaji How about through API, do you know? Im sending request using apify API. Tysm!
Maybe not jump but could we keep
Maybe not jump but could we keep scrolling and only keep data based on a date range like this actor? I'm wondering because this actor is having issues scraping anything past 2023
There was some downtime in Apify's API
There was some downtime in Apify's API today around 12:45 UTC?
Lots of my actors have failed because they couldn't get the INPUT record from Apify
```...
I noticed a lot of failed runs and
I noticed a lot of failed runs and timeout errors between 11:30 and 12:30 UTC today. It looks like there might have been a server issue during that time.
There’s nothing mentioned on the status page, so I just wanted to check if something happened and whether there will be any update or info shared about it. @vladdy...
I'm using HttpCrawler from Crawlee doing
I'm using HttpCrawler from Crawlee doing a
PUT request. I get the following error: Error: Resource served Content-Type application/octet-stream, but only text/html, text/xml, application/xhtml+xml, application/xml, application/json are allowed. Any possibility of allowing application/octet-stream or are PUT not possible? EDIT: Found it I had set a header to only accept json. Removing that header of the request solved the issue.I use this to check the currently used
I use this to check the currently used dataset:
await (await Actor.openDataset()).getInfo(). However, often times it is not up to date (I feel like some eventually consistent problem is playing). Is it possible of fetching the data when it is consistent? Currently I'm just waiting 3 seconds before fetching, but that feels "hacky".Get featured in Featured Developers section on Store homepage.
Hello @Public actor developer 's 👋
We are looking forward to change featured developers yet again and Actors on out store homepage.
And I am looking for devs and their Actors to feature, I think the first right is for the developers building great Actors, are active in community, and needs growth....
Hey all,
Hey all,
I am trying to publish an actor, but it fails through the automatic tests.
My actor expects a VAT number, and it must be valid. If it is invalid I return the 'Actor.exit()' in my code.
...
I'm disappointed with Apify's proxy. As
I'm disappointed with Apify's proxy. As a paid user, I expect better performance. It works fine on the Apify platform, but it doesn't support HTTPS when used locally. While it's okay for simple GET/POST requests, it fails with browser automation.
Hey all just a follow to my post here
Hey all just a follow to my post here yesterday...
The response to this:
"I was excited to try and recreate my agent team that I already use on Apify, but I keep running into all these problems I haven't had anywhere else and I'm starting to wonder if it's worth putting in the time to continue using Apify. Don't get wrong I think Apify is great for launching simple things like a youtube scraper etc. but for things like deploying a 30 Agent Team as an app I am starting to wonder if the learning curve for using Apify to do this is worth the time?"
...
Hi everyone! 😊
Hi everyone! 😊
We are currently developing a web application targeted at coaches and individuals in network marketing. We’re planning to integrate Apify into our platform to offer automated services to our users.
The idea is to automatically create an Apify account for each new user who registers on our platform and retrieve their API key. Initially, we want to provide each user with $5 worth of Apify services per month in our free plan. Later, for our premium plans, we plan to offer Apify credits that users can purchase and manage directly through our platform....
This is an innocuous warning that your
This is an innocuous warning that your Dockerfile defines this environment argument but doesn't use it. It is actually only useful in monorepos where you have multiple Actors in the same repo and you want to have shared code but know which directory was the Actor started from
apify-sdk-js/packages/apify at master · ...
I'm wondering if anybody ever extended/customized the https://github.com/apify/apify-sdk-js/tree/master/packages/apify ? Why do I wanna do that? I need to run actors on my own servers inside my own platform where tasks are coming from rabbitmq and I aggregate everything about the run including logs of the actors
429
Hello 👋
Does the HTTP crawler use fingerprinting by default when sending requests?
Because I get 429 too many requests from the API I am web scraping, and I suspect that my header values are the cause of it....