Retry requests with different headers and etc

Can we get this page also in JS version: https://crawlee.dev/python/docs/guides/error-handling
Also I am interested regarding best practices how to change headers when 403 or 429 are encountered, so I don't repeat same request with same headers and different IP only

Error handling | Crawlee for Python · Fast, reliable Python web cr...

Crawlee helps you build and maintain your Python crawlers. It's open source and modern, with type hints for Python to help you catch bugs early.

Olexandra•11/12/25, 10:25 AM

Hi, thanks for your questions.

Headers rotation part:
First you need to have a pool of header sets and a getter logic to use afterwards (randomised or index based). That you can achieve manually or by employing a package like header-generator. If you want to keep track of used header sets inside of your pool, you can use request.retryCount. Then, if your Actor handles request sending automatically, you can adjust the headers in errorHandler once one of mentioned errors occurs. You can also remove 403 and 429 from the the list of blocked statuses under sessionPoolOptions, in this case you could add headers rotation inside requestHandler, don't forget to throw exception afterwards, so the request is retried. I f you use BasicCrawler, you will simply get a new set of headers every time you send request inside of requestHandler.

Documentation part:
I'll reach out to our team to share your interest in mentioned documentation page.

memo23OP•11/14/25, 7:38 AM

hey @Olexandra thanks for feedback, I implemented something, I'll get back you on this later

memo23OP•11/14/25, 7:39 AM

can we enforce on user max memory for PPR actors or they can override it:

memo23OP•11/14/25, 7:39 AM

memo23OP•11/14/25, 7:40 AM

bascially as I can see over API they can override my 512, but I don't want to allow that

Matous•11/18/25, 9:55 AM

Hey @memo23, there is a way, check maxMemoryMbytesmaxMemoryMbytes in actor.json docs
This way, you prevent users from overriding memory with higher values, and API requests memory will be clamped to specified value (if higher) and the run will still start.

actor.json | Platform | Apify Documentation

Learn how to write the main Actor config in the .actor/actor.json.actor/actor.json file.

memo23OP•11/18/25, 9:56 AM

I know thatfor PPE, can we use also for PPR?

Matous•11/18/25, 10:12 AM

Hey, I don't see a reason why not; it shouldn't be connected to the pricing model. Anyway, you can try it, right?

memo23OP•11/18/25, 10:13 AM

ok, I will for sure