xenial-black
xenial-black•2y ago

Error in deploymeny with AWS lambda

Getting this error in AWS lambda deployment : 
ENOENT: no such file or directory, mkdir '/var/task/storage/key_value_stores/__CRAWLEE_MIGRATING_KEY_VALUE_STORE__'. Take further actions accordingly.
ENOENT: no such file or directory, mkdir '/var/task/storage/key_value_stores/__CRAWLEE_MIGRATING_KEY_VALUE_STORE__'. Take further actions accordingly.
attaching the zip folder used for deployment. (I think in new files/folders cannot be created, I might be wrong) How can I solve this problem?
No description
1 Reply
Lukas Celnar
Lukas Celnar•2y ago
Hi We generally discourage using the JSON files on lambda, It is better to just disable this and keep only the in memory data. See: https://crawlee.dev/docs/deployment/aws-cheerio Hope this helps 🙂
Cheerio on AWS Lambda | Crawlee
Locally, we can conveniently create a Crawlee project with npx crawlee create. In order to run this project on AWS Lambda, however, we need to do a few tweaks.

Did you find this page helpful?