How do I add headers to BasicCrawler?

I have a URL that requires some headers to be accessible, how do i add headers to BasicCrawler so I can crawl it?

When you add request try request

headers

headers

property
https://crawlee.dev/api/core/class/Request#headers

Request | API | Crawlee

Represents a URL to be crawled, optionally including HTTP method, headers, payload and other metadata.
The RequestRequest object also stores information about errors that occurred during processing of the request.

Each RequestRequest instance has the uniqueKeyuniqueKey property, which can be either specified
manually in the constructor or generated automaticall...

Lukas Krivka•2/8/23, 8:41 PM

Just remember BasicCrawler doesn't do any requests by default, you need to use the provided sendRequestsendRequesthttps://crawlee.dev/api/basic-crawler/interface/BasicCrawlingContext#sendRequest

or just use CheerioCrawler

BasicCrawlingContext | API | Crawlee