Proxy example with PlaywrightCrawler
This is probably a simple fix but I cannot find an example of crawlee using a simple proxy link with Playwright. If anyone has a working example or know what is wrong in the code I would really appreciate your help. Here is the code I have been working with:
(I wish I could copy and paste of the code here but the post go over the character limit
I get the following error from the code:
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/jr/Desktop/Pasos_webscraping/.venv/lib/python3.12/site-packages/playwright/_impl/_connection.py", line 528, in wrap_api_call
raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None
playwright._impl._errors.Error: Page.goto: net::ERR_CERT_AUTHORITY_INVALID at https://www.instagram.com/p/DGWPnK1S0K2/
Call log:
- navigating to "https://www.instagram.com/p/DGWPnK1S0K2/", waiting until "load"
Any help on how to proceed would be greatly appreciated!
(I wish I could copy and paste of the code here but the post go over the character limit
I get the following error from the code:
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/jr/Desktop/Pasos_webscraping/.venv/lib/python3.12/site-packages/playwright/_impl/_connection.py", line 528, in wrap_api_call
raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None
playwright._impl._errors.Error: Page.goto: net::ERR_CERT_AUTHORITY_INVALID at https://www.instagram.com/p/DGWPnK1S0K2/
Call log:
- navigating to "https://www.instagram.com/p/DGWPnK1S0K2/", waiting until "load"
Any help on how to proceed would be greatly appreciated!
cooklikeimbook
Instagram
Don’t complicate weight loss.
Whole Pan: 740 Calories | 78g Protein | 12g Fat | 67g Carbs
INGREDIENTS:
- 300g skinless chicken thighs
- 30mL Low Sodium Soy sauce
- 7-8g Brown sugar
- 1 tsp Ginger powder- ginger paste does better than powder
- Black pepper
- 3-4 cloves Garlic
- 15mL Lemon juice ( I only had lime leave me alone)
- 180g Whit...
Whole Pan: 740 Calories | 78g Protein | 12g Fat | 67g Carbs
INGREDIENTS:
- 300g skinless chicken thighs
- 30mL Low Sodium Soy sauce
- 7-8g Brown sugar
- 1 tsp Ginger powder- ginger paste does better than powder
- Black pepper
- 3-4 cloves Garlic
- 15mL Lemon juice ( I only had lime leave me alone)
- 180g Whit...
Likes
3478
cooklikeimbookInstagram
Don’t complicate weight loss.
Whole Pan: 740 Calories | 78g Protein | 12g Fat | 67g Carbs
INGREDIENTS:
- 300g skinless chicken thighs
- 30mL Low Sodium Soy sauce
- 7-8g Brown sugar
- 1 tsp Ginger powder- ginger paste does better than powder
- Black pepper
- 3-4 cloves Garlic
- 15mL Lemon juice ( I only had lime leave me alone)
- 180g Whit...
Whole Pan: 740 Calories | 78g Protein | 12g Fat | 67g Carbs
INGREDIENTS:
- 300g skinless chicken thighs
- 30mL Low Sodium Soy sauce
- 7-8g Brown sugar
- 1 tsp Ginger powder- ginger paste does better than powder
- Black pepper
- 3-4 cloves Garlic
- 15mL Lemon juice ( I only had lime leave me alone)
- 180g Whit...
Likes
3478
