page.route for that but in the context of PlaywrightCrawler, would I just put those in requestHandler? (Won't that be too late?)page.routePlaywrightCrawlerrequestHandler
F
EpreNavigationHooks is what you're looking for: https://crawlee.dev/api/playwright-crawler/interface/PlaywrightCrawlingContext#blockRequests
L
FELL
L
E
Network.setBlockedURLs "Blocks URLs from loading" 
E.jpg.jpgblockRequests from crawlingContext results in it always erroring with ERROR PlaywrightCrawler: Request failed and reached maximum retries. ArgumentError: Cannot convert object to primitive value in object options
regardless of which options are used.
Getting blockRequests` from the playwrightUtils exported by crawlee does work.E
M
FFFLLFFLFFFE<img> tag for a .jpgsrc to optionally grab them later; this pattern does not seem to work since there is no element to get the src from. Is there a better way to optionally get certain images?LIpreNavigationHooksNetwork.setBlockedURLsblockRequestscrawlingContextERROR PlaywrightCrawler: Request failed and reached maximum retries. ArgumentError: Cannot convert object to primitive value in object
regardless of which options are used.
Getting preNavigationHooks: [
async (crawlingContext, gotoOptions) => {
const { blockRequests, page, addCookies } = crawlingContext;
if (cookies) {
await addCookies(cookies);
}
await playwrightUtils.blockRequests(page, {
urlPatterns,
});
await page.setViewportSize({
width: 1280,
height: 720,
});
},
],<img>srcsrcpreNavigationHooks: [
async (crawlingContext, gotoOptions) => {
const { blockRequests } = crawlingContext;
await blockRequests();
},
]const crawler = new PlaywrightCrawler({
proxyConfiguration,
preNavigationHooks: [
async (crawlingContext, gotoOptions) => {
const { blockRequests } = crawlingContext;
await blockRequests();
},
],
requestHandler: async (context) => {
console.dir(context, { depth: 0 });
},
});