harsh-harlequin•17mo ago
Open chrome (not test version) in crawlee
Hello, in crawlee / puppeteer I can easily open the chrome test browser with a few lines of codes.
The problem is that this test chrome browser doesn't have cookies that I've on my regular chrome, so I need to reauthenticate (I use gmail) and it's more tedious.
If I could just open a tab in the standard chrome browser it would use the same cookies.
Is this something doable, or I'm asking something that doesn't respect the reccomandations and should be done differently?
I could also export manually the cookies and load them in crawlee, but it's a bit tedious to do it manually all the times.
Thanks
2 Replies
You never expected to run browser installed on your system, because scraper supposed to be deployed somewhere and be able to run miltiple times as in current Apify cloud.
You can get some info on how to solve your issues with cookies / headers here:
https://docs.apify.com/academy/api-scraping/general-api-scraping/cookies-headers-tokens
https://docs.apify.com/academy/puppeteer-playwright/common-use-cases/logging-into-a-website#passing-around-cookies