@Kacka H. @Lukas Krivka @vladdy @

@Kacka H. @Lukas Krivka @vladdy @Ella Greetings dear collegium, I'm trying to use my custom web scraper inside apify but it doesnt retrieve data from .json output which I need

azzouzana•10/30/25, 7:28 AM

Is it js or python? Is it using crawlee?

sour-pinkOP•10/30/25, 7:28 AM

azzouzana•10/30/25, 7:29 AM

Please move your others messages here to keep the general channel clean

sour-pinkOP•10/30/25, 7:29 AM

okay

azzouzana•10/30/25, 7:29 AM

So you're saying you're able to run flawlessly from within Apify console but unable to get the output from within n8n?

azzouzana•10/30/25, 7:30 AM

I see that you're starting it from n8n correct?

sour-pinkOP•10/30/25, 7:30 AM

correct

sour-pinkOP•10/30/25, 7:32 AM

i tried an apify node as well as an http request

azzouzana•10/30/25, 7:32 AM

Are you using the official Apify node or raw HTTP calls?

azzouzana•10/30/25, 7:32 AM

Maybe you're using an asynchronous mode?

sour-pinkOP•10/30/25, 7:33 AM

for now http calls seem to be better

MEE6•10/30/25, 7:33 AM

@Patrik Barracuda Šlachta just advanced to level 1! Thanks for your contributions!

sour-pinkOP•10/30/25, 7:33 AM

i tried an Apify call but it just wouldnt work

azzouzana•10/30/25, 7:35 AM

What do you meant wouldn't work? Could you please share the API endpoint you're using?

sour-pinkOP•10/30/25, 7:35 AM

https://api.apify.com/v2/datasets/d4lueKKWGPt9tFfxb/items?format=json&clean=true&limit=100&desc=true

auth bearer w/ my token

sour-pinkOP•10/30/25, 7:36 AM

and I tried asking any LLM but they just wouldnt help me at all

azzouzana•10/30/25, 7:38 AM

I was referring to the API endpoint you're doing a POST request to to see whether its sync or async

azzouzana•10/30/25, 7:40 AM

Please mention the exact thing that doesn't work.
What output do you get when you trigger the run using HTTP request?

sour-pinkOP•10/30/25, 7:41 AM

sour-pinkOP•10/30/25, 7:42 AM

sour-pinkOP•10/30/25, 7:43 AM

so I am using an HTTP rrequest because the custom scraper isn't having an apify call

azzouzana•10/30/25, 7:47 AM

Something to pinpoint in your 2nd screenshot is that you're doing a POST request to read a dataset.

To read a dataset you'd have to send GET request. (Assuming the dataset exists).

POST should be used to trigger a run, use a synchronous endpoint to wait for it to finish. Please refer to this section https://docs.apify.com/academy/api/run-actor-and-retrieve-data-via-api#synchronous-flow, or refer your LLM to its content

Run Actor and retrieve data via API | Academy | Apify Documentation

**Learn how to run an Actor/task via the Apify API, wait for the job to finish, and retrieve its output data.

azzouzana•10/30/25, 7:49 AM

In first screenshot (using Apify node), you don't need to do anything, (HTTP calls/response are implemented, you'd just have to trigger it + waitForFinish, and you'd get your data from the default dataset associated with that run

azzouzana•10/30/25, 7:50 AM

Or is that you don't see the actor you want to trigger in the list of actors? (Referring to Apify n8n screenshot). If that's the case, please double check your authentification (Apify API key connection)

sour-pinkOP•10/30/25, 7:52 AM

okay so I first post the request for it to run and then I have it inside the body as a .json code to retrieve the data from the run?

sour-pinkOP•10/30/25, 7:52 AM

and I have the key in the header

sour-pinkOP•10/30/25, 7:52 AM

...

sour-pinkOP•10/30/25, 7:53 AM

is it better for me to run an HTTP Request or an Apify node?

azzouzana•10/30/25, 7:59 AM

Definitely the Apify node is the way to go, it's official and no need to handle the nitty details of HTTP requests (especially when you're not technical)

azzouzana•10/30/25, 8:08 AM

Please let me know if you get it to work

sour-pinkOP•10/30/25, 8:29 AM

I'm trying to make it

sour-pinkOP•10/30/25, 8:44 AM

I can't seem to be able to set it up

sour-pinkOP•10/30/25, 8:45 AM

I'm trying to POST it and retrieve the data even with using a .json string accurately but it just isn't possible

sour-pinkOP•10/30/25, 8:47 AM

we are trying to automate second half sport betting with 85% accuracy based on TA

MEE6•10/30/25, 8:47 AM

@Patrik Barracuda Šlachta just advanced to level 2! Thanks for your contributions!

sour-pinkOP•10/30/25, 8:47 AM

and we need an accurate halftime detecting tool

sour-pinkOP•10/30/25, 8:49 AM

https://api.apify.com/v2/datasets/dA1ueKKWGPt9tFfxb/items?format=json&limit=1000&clean=true

sour-pinkOP•10/30/25, 8:55 AM

can you help me please?

sour-pinkOP•10/30/25, 9:07 AM

because the API from sportsdata.io would have cost us at least 10,000$ so we were looking at running queries for every single upcoming match every 6 minutes to see if it's at halftime

sour-pinkOP•10/30/25, 9:08 AM

so if you can help me we can maybe exchange "the odds api" as well which is another 2,500$ a year

azzouzana•10/30/25, 9:24 AM

What's the ID of your actor you're trying to run?

azzouzana•10/30/25, 9:29 AM

I see you're trying to run apify/web-scraper with this input, let me check..

azzouzana•10/30/25, 9:37 AM

I've managed to run the actor you're trying to run and it's working OK