Customize Run Options(memory and time out) in Playwright Node.js Crawler Actor
Hello everyone
I’ve been running into some issues when trying to customize the Run Options for my Apify Actor, especially with increasing the allocated memory.
Does anyone know if it’s possible to configure or increase the memory amount directly from within a PlaywrightCrawler (Crawlee) Node.js code? Or is this something that can only be set through the Apify Console / API run options?
If you’ve had experience dealing with this, I’d really appreciate any insights or best practices you can share
2 Replies
from crawlee's perspective:
CheerioCrawler(
...your_config
new Configuration({
availableMemoryRatio: 0.7,
maxUsedCpuRatio: 0.6,
}),
you can use those ratios, or if you look into the definition of Configuration there are also keys for fixed values.
but I don't know about the apify platform because I don't use it.
I've already tried it, but apify platform didn't work with this solution
Anyway, thanks for you kind advice.