ratty-blush•2y ago
100 Page Limit on Content Crawler
Running a content crawler from Stack-Ai and repeatedly scraping only 100 pages. I am just testing out the platform so I am using a trial. Is that the problem? Just tracking down what the problem is across the two apps.
5 Replies
The actor normally has an input where you can configure this and other settings. Does the Stack AI integration allow setting it? It was not developer by Apify
ratty-blushOP•2y ago
The setting would be maximum pages right?
Yes
passive-yellow•2y ago
I am getting this message when attempting to scrape a website : "You've set memory lower than the minimum of 1024MB allowed for this Actor". My account was overcharged and the usage was depleted. However, my account was subsequently credited with the amount overcharged. But now my queries won't execute due to insufficient memory. Thanks for your help.
I'm not sure where on Stack AI you can configure memory but 1024 is minimum for this actor (so it has reasonable speed)