Using SessionStorage in PuppeteerCrawler
How can we use SessionStorage in Puppeteer Crawler?
I didn't find anything related to Session Storage in the documentation so I tried
to guess some reasonable config values.
useSessionPool: true,
persistCookiesPerSession: true,
maxConcurrency
sessionPoolOptions: {
maxPoolSize: 1,
sessionOptions: {
maxUsageCount: 9999,
maxErrorScore: 9999,
maxAgeSecs: 99999,
},
},
I still looks like between requests the data is wiped out
(there is always an about:blank request showing up between the different requests)
Thanks in advance!
I didn't find anything related to Session Storage in the documentation so I tried
to guess some reasonable config values.
useSessionPool: true,
persistCookiesPerSession: true,
maxConcurrency
sessionPoolOptions: {
maxPoolSize: 1,
sessionOptions: {
maxUsageCount: 9999,
maxErrorScore: 9999,
maxAgeSecs: 99999,
},
},
I still looks like between requests the data is wiped out
(there is always an about:blank request showing up between the different requests)
Thanks in advance!
