The community member is facing issues with reCaptcha V2 while scraping and is looking for a way to programmatically get the captcha, solve it, and send the response back to continue scraping. Some community members suggested using services like Apify or nopecha, while others recommended throwing away the session if the captcha is not mandatory. The community member is interested in solving the captcha internally rather than using third-party services, and another community member offered to assist with an automatic reCaptcha v2 solver if the original poster contacts them directly.
I'm facing some captchas, reCaptcha V2 in this case. After I solve the captcha, then it'll 'mark' me as 'safe' and I can continue scraping. But I'm wondering how should I approach getting the captcha programmatically, solve it and send back the required response. This way I can run on a server and 'whitelist' it's IP or do the same for proxies(it keeps throwing captchas on proxies too!).
I see this heavily promoted when it comes to captchas, but from what I gather, I can neither see the source code of how it grabs captchas(I think it's the user's responsibility to do so and send it) or else. It's just an integration to a 3rd party.
The interesting part to me is how to actually get that captcha, visualize it(to myself) and solve it and send it back to G. And once I know how to do this, I'll be able to send the token(?) to a 3rd party as well.
As for throwing away the session, yes, I could do that, but solving the captcha will 'whitelist' the session and it'll be more reliable than throwing out thousands of proxies. Also, it's interesting to me to know how it's actually done.
