shockwave
shockwave3mo ago

Needed timeout parameter.

I'm scraping google map review. Actor is 'agents/google-maps-reviews'. I must scrape as much as possible, during limited duration(120s). But timeout is critical. I can specify maxItems, but scraping rate is variable, so I can't decide the propriety value of maxItems. It sometimes scraps 2.9 reviews/s and sometimes 6.3 reviews/s. I have upgraded to "Scale plan", but no effect. How can I solve this? Can you add parameter "timeout"? I'm looking for your reply. Thanks in advance.
2 Replies
thenetaji
thenetaji3mo ago
if you are using it from external api, kill it after x seconds. let me know if you are doing in another way
Matyas Cimbulka
Matyas Cimbulka3mo ago
Hello, @shockwave you can use the timeout parameter to limit the execution of the Actor. When the Actor run reaches the value of seconds specified by this parameter it will end the run with status TIMED-OUT. All retrieved results can be extracted from the dataset. The timeout parameter is a query parameter which isn't part of the input. Here is a reference to API call which will return results after the Actor finishes execution: https://docs.apify.com/api/v2/act-run-sync-get-dataset-items-post
Run Actor synchronously with input and get dataset items | Apify Do...
<span class='openapi-clients-box'></span><span id='/reference/actors/run-actor-synchronously-and-get-dataset-items/run-actor-synchronously-with-input-and-get-dataset-items'></span><span id='/reference/actors/run-actor-synchronously-with-input-and-get-dataset-items'></span><span id='tag/ActorsRun-Actor-synchronously-and-get-dataset-items/operatio...

Did you find this page helpful?