Firefox Error in PlaywrightCrawler

We are receiving an intermittent error using Firefox with PlaywrightCrawler (an example is run

w9I8udSOta4b0kEw8

w9I8udSOta4b0kEw8

). The error is:

2023-06-10T19:44:32.733Z /home/myuser/node_modules/playwright-core/lib/utils/index.js:100
2023-06-10T19:44:32.735Z   if (!value) throw new Error(message || 'Assertion error');
2023-06-10T19:44:32.737Z                     ^
2023-06-10T19:44:32.739Z 
2023-06-10T19:44:32.741Z Error: Assertion error
2023-06-10T19:44:32.744Z     at assert (/home/myuser/node_modules/playwright-core/lib/utils/index.js💯21)
2023-06-10T19:44:32.746Z     at FrameManager.frameAttached (/home/myuser/node_modules/playwright-core/lib/server/frames.js:133:25)
2023-06-10T19:44:32.748Z     at FFPage._onFrameAttached (/home/myuser/node_modules/playwright-core/lib/server/firefox/ffPage.js:220:30)
2023-06-10T19:44:32.750Z     at FFSession.emit (node:events:513:28)
2023-06-10T19:44:32.752Z     at /home/myuser/node_modules/playwright-core/lib/server/firefox/ffConnection.js:248:41

2023-06-10T19:44:32.733Z /home/myuser/node_modules/playwright-core/lib/utils/index.js:100
2023-06-10T19:44:32.735Z   if (!value) throw new Error(message || 'Assertion error');
2023-06-10T19:44:32.737Z                     ^
2023-06-10T19:44:32.739Z 
2023-06-10T19:44:32.741Z Error: Assertion error
2023-06-10T19:44:32.744Z     at assert (/home/myuser/node_modules/playwright-core/lib/utils/index.js💯21)
2023-06-10T19:44:32.746Z     at FrameManager.frameAttached (/home/myuser/node_modules/playwright-core/lib/server/frames.js:133:25)
2023-06-10T19:44:32.748Z     at FFPage._onFrameAttached (/home/myuser/node_modules/playwright-core/lib/server/firefox/ffPage.js:220:30)
2023-06-10T19:44:32.750Z     at FFSession.emit (node:events:513:28)
2023-06-10T19:44:32.752Z     at /home/myuser/node_modules/playwright-core/lib/server/firefox/ffConnection.js:248:41

Per some other forums, I backleveled to Playwright version 1.26.0, which apparently has a more stable version of Firefox, but it continues to happen. We really hope to use Firefox with this actor, as we are getting more consistent results than with Chrome. Does anyone have any ideas? Thanks in advance!

Pepa J•6/12/23, 7:42 AM

Hello @danhelfman ,
This looks more like and issue related to the Playwright than Crawlee.
I was only able to find this issue https://github.com/microsoft/playwright/issues/9741, but I believe you already run into this one while you were investigating.
Unfortunately I can't help you much with this one without any minimal reproducible example.

Wwispy-yellow Hello @danhelfman , This looks more like and issue related to the Playwright tha...

dangerous-fuchsiaOP•6/14/23, 4:03 PM

Thank you for getting back to me. Yes, we are thinking we may need to use Playwright and Chrome in the meantime, until the Firefox issue has been resolved.