metropolitan-bronze
metropolitan-bronze•3y ago

Resume after crash

Hey, I've had a Cheerio crawler running for couple of hours, but it crashed. I'm wondering if it's possible to renew the crawl from the place it stopped at. I can see there are some files left in the
key_value_stores
key_value_stores
dir:
No description
3 Replies
Lukas Krivka
Lukas Krivka•3y ago
Hello, yes it is, you just need to start the run without purge local stores. You can set env var CRAWLEE_PURGE_ON_START to 0.
metropolitan-bronze
metropolitan-bronzeOP•3y ago
Gotcha, thanks! 🙂
MEE6
MEE6•3y ago
@ThePhantom just advanced to level 1! Thanks for your contributions! 🎉

Did you find this page helpful?