Apify Discord Mirror

n
nikus
Offline, last seen yesterday
Joined March 12, 2025
Im trying to make a simple crawler, how do proper control the redirects? Some bad proxies sometimes redirect to auth page , in this case i want to mark the request as failed if the redirect URL ( target ) contains something like /auth/login. Whats the best to handle this scenarios and abort the request earlier?
2 comments
A
n