which browser is the best to crawl
As title said
I’m using chromium currently but it is cpu heavy in usage
Killing browser do not kill the process and because of that it’s easy to get 100% cpu usage pretty quickly
(I’m crawling thousands of websites where on each I’m looking for different data) I already try to load pure html without css, images and other assets, that helped a lot but issue is still there
I’m using chromium currently but it is cpu heavy in usage
Killing browser do not kill the process and because of that it’s easy to get 100% cpu usage pretty quickly
(I’m crawling thousands of websites where on each I’m looking for different data) I already try to load pure html without css, images and other assets, that helped a lot but issue is still there
