foreign-sapphire•4y ago
puppeteer_dev_chrome_profile
running puppeteer crawler on amazon linux 2 fills the tmp directory rapidly with some profile files - using up all the diskspace. can I do something about this?
files look like this: puppeteer_dev_chrome_profile-igd7yw puppeteer_dev_chrome_profile-wwkJvK puppeteer_dev_chrome_profile-IWxYXH puppeteer_dev_chrome_profile-WX4JH2 ...
files look like this: puppeteer_dev_chrome_profile-igd7yw puppeteer_dev_chrome_profile-wwkJvK puppeteer_dev_chrome_profile-IWxYXH puppeteer_dev_chrome_profile-WX4JH2 ...
6 Replies
What is the version of Crawlee and Puppeteer?
foreign-sapphireOP•4y ago
crawlee@3.0.4 puppeteer@15.1.1 - I'm not sure if I understand correctly but I thought there should only be one profile necessary for a crawl...
@bs just advanced to level 3! Thanks for your contributions! 🎉
foreign-sapphireOP•4y ago
at the moment i have about 300 profile files in tmp...
Yeah, those should not accumulate, let me ask
Or better, could you please create an issue https://github.com/apify/crawlee. Will give more context. Thanks
foreign-sapphireOP•4y ago
sure
hm. tried to reproduce and now the problem is gone. will keep investigating..