fair-rose•2y ago
How to recover from/detect chrome crash
I'm observing chrome crashing (no scanning activity, lots of chrome_crashpad in
top) and the crawlee playwrightcrawler process stalls untill I kill all Chrome instances. After that, Crawlee continues working (though instantly overloading memory, and chrome instances taking 100% of the CPU).
Is there a way to detect this happening and gracefully restarting chrome?3 Replies
Can you please post your environment and how you run it?
fair-roseOP•2y ago
It's a docker instance based on mcr.microsoft.com/playwright:v1.35.1-jammy running on Digitalocean app platform pro pan with 1vCPU and 2GB ram.
crawlee is ran in a bullMQ worker
Crawlee should clean up the instances but perhaps in your case it doesn't happen. I would suggest submitting in issue to the repo