Error accessing the requests sometimes when two crawlers are running in parallel
INFO Error: ENOENT: no such file or directory, open '~/storage/request_queues/default/iQ0kKmJLF8Tlwio.json'
Error: ENOENT: no such file or directory, mkdir ~'/storage/request_queues/default/GBHQqH6WEETimdi.json.lock'
It works most of the time, but sometimes this throws error and one of the crawler wont start.
Does anyone know what might be the reason?
Error: ENOENT: no such file or directory, mkdir ~'/storage/request_queues/default/GBHQqH6WEETimdi.json.lock'
It works most of the time, but sometimes this throws error and one of the crawler wont start.
Does anyone know what might be the reason?
