The community member is using a Puppeteer Crawler that works well in headed mode, but encounters 403 errors when running in headless mode. They tried using xvfb but it did not fix the issue. The community members suggest trying different proxy groups, modifying headers, and using Playwright with Firefox as it may be more stealthy. One community member mentions that they were able to fix the issue temporarily using xvfb, but another community member states that they were unable to fix it with xvfb and instead found success using Playwright and Firefox.
I have a Puppeteer Crawler that works almost flawless in headed mode, but if I go headless all the requests are getting 403 errors. I was thinking that xvfb should fix this but unfortunately it doesn't. Any other ideas ?
