Apify

Apify Discord Mirror

Updated last year

playwright and proxy problem

At a glance

The community member is experiencing an issue where they receive a captcha when trying to access a page using a proxy with Playwright, but the same proxy works without issue in a regular browser. The community members suggest that the page may be detecting the automated browser and blocking it when using a proxy. One community member notes that the captcha may not appear in a standard browser when using the SwitchyOmega extension, as it has already verified the identity through cookies from previous visits. They recommend trying RESIDENTIAL proxies, which the other community member confirms have the best success rate, though they are still blocked most of the time. The community member has found that RESIDENTIAL proxies with a FR country code work best for the specific URL https://www.coursesu.com/.

Useful resources
HHonzaS
·
When I try to access page with proxy with playwright I get captcha. Without proxy it works with no problem. But what is weird that if I use the same proxy in the regular browser via SwitchyOmega extension then the page loads also without problem. So I think page somehow detects that automated browser is using proxies.
Did anyone encounter this problem?
H
H
2 comments
HHamza
It may not display the captcha in a standard browser when using SwitchyOmega, as it has already verified your identity through cookies from previous visits.

Have you tried using RESIDENTIAL proxies?
HHonzaS
Yeah, looks like you are right 👍 it was because of cookies, in anonymous window I get captcha.
RESIDENTIAL proxies have the best rate of success but still blocked most of the time.
It is this url https://www.coursesu.com/ I have found out that RESIDENTIAL with FR country code works best, so I will work with that. Thanks a lot for the help.
Add a reply
Sign up and join the conversation on Discord