Faster task startup?

Any options for faster startup of an actor task? Specifically the

ACTOR: Pulling Docker image from repository.

ACTOR: Pulling Docker image from repository.

ACTOR: Pulling Docker image from repository.

ACTOR: Pulling Docker image from repository. and the

ACTOR: Starting Docker container.

ACTOR: Starting Docker container.

ACTOR: Starting Docker container.

ACTOR: Starting Docker container. steps.

skinny-azureOP•9/28/22, 6:06 AM

In other words, have the task payload ready to run, on API call, with as little delay as possible. I suppose I could keep it running 24/7 but that would be a waste.

Alexey Udovydchenko•9/28/22, 9:15 PM

Latest crawlee under 128Mb with cheerio crawler should be done in 5sec (average) per request, even if its only single request in run or task, so just use light container and find a way to access web data wo browser and you will have solution which works comparable to regular API

Alexey Udovydchenko•9/28/22, 9:16 PM

There might be lags if you use residential proxies, can be solved by fast retrying i.e. set timeout to 10sec per request or check if you can use datacenter proxies instead residential

Lukas Krivka•9/29/22, 9:10 AM

Use the most base image. Apify team is working on improving the start times, they got slower lately.