2 replies

Proxy example with PlaywrightCrawler

This is probably a simple fix but I cannot find an example of crawlee using a simple proxy link with Playwright. If anyone has a working example or know what is wrong in the code I would really appreciate your help. Here is the code I have been working with:

(I wish I could copy and paste of the code here but the post go over the character limit

I get the following error from the code:

^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/jr/Desktop/Pasos_webscraping/.venv/lib/python3.12/site-packages/playwright/_impl/_connection.py", line 528, in wrap_api_call
raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None
playwright._impl._errors.Error: Page.goto: net::ERR_CERT_AUTHORITY_INVALID at https://www.instagram.com/p/DGWPnK1S0K2/
Call log:
- navigating to "https://www.instagram.com/p/DGWPnK1S0K2/", waiting until "load"

Any help on how to proceed would be greatly appreciated!

cooklikeimbook

Don’t complicate weight loss.

Whole Pan: 740 Calories | 78g Protein | 12g Fat | 67g Carbs

INGREDIENTS:
- 300g skinless chicken thighs
- 30mL Low Sodium Soy sauce
- 7-8g Brown sugar
- 1 tsp Ginger powder- ginger paste does better than powder
- Black pepper
- 3-4 cloves Garlic
- 15mL Lemon juice ( I only had lime leave me alone)
- 180g Whit...

Likes

3478