useful-bronze•2y ago
Python rotating proxy with apify request
Every time I attempt web scraping, the website blocks my efforts. Despite utilizing Apify's rotating proxy, I'm unable to access the data. I'm currently using the requests library. Would anyone be able to share a Python code example for web scraping with a rotating proxy using requests?
2 Replies
Depends on blocking type you can try to resolve it by experimenting with request headers (i.e. try different devices) or, if its heavy blocking by CloudFlare or similar you will need to use browser.
useful-bronzeOP•2y ago
I have tried changing the various parameters of the header but still no luck. if you have any code reference for rotating proxy, could you please share it with me?