Maintain the same browser/scope
Hi!
I'm having a issue while scraping a web app. This app have heavy use on context and cookies, and when I enqueue over 80 urls using EnqueueLink, after about the 20th url scraped, my algorithm opens another browser windows loosing scope, and loosing access to the urls which needs the context or cookes.
So, is there any way to config Crawlee to avoid opening more browsers? Or maybe if is there any way to keep the first scope even between browsers.
Thanks!
I'm having a issue while scraping a web app. This app have heavy use on context and cookies, and when I enqueue over 80 urls using EnqueueLink, after about the 20th url scraped, my algorithm opens another browser windows loosing scope, and loosing access to the urls which needs the context or cookes.
So, is there any way to config Crawlee to avoid opening more browsers? Or maybe if is there any way to keep the first scope even between browsers.
Thanks!
