Apify Discord Mirror

Updated 5 months ago

change proxies while running

At a glance

The community member has a question about changing proxies during a Puppeteer process. They want to start with one proxy (proxy1) and then switch to another (proxy2) at some point. The comments suggest that this is not currently supported by the crawlee library, and the community member is trying to create a function to achieve this. However, they mention that it gets "messed up" when the concurrency is higher than 1. There is no explicitly marked answer in the comments.

Hello,
I have a question regarding Puppeteer, I want to change the proxies at one point during the process.

Is this achievable ?
for example I have proxy1 and proxy2, I start by using proxy1 and at one point I switch to proxy2.
N
n
H
7 comments
Did you find any solution?
This is not supported by crawlee right now, so the only think that comes to mind is to try to change some inner property of the crawler during the run. Did you try to change proxy configuration on crawler object?
Yes it gets messed somehow when concurrency is higher than 1.
I’m trying to create a function to do this
Add a reply
Sign up and join the conversation on Discord