robust-apricot•3y ago
How to transfer data between playwrightcrawler and cheeriocrawler?
I want to scrape javascript generated HTML with playwrightcrawler and then parse it with cheeriocrawler:
const selector = 'div[class="space-y-4 max-w-2xl mx-auto"]';
const htmlCode = await page.innerHTML(selector);
2 Replies
there is parseWithCheerio function already included in playwrightcrawler https://crawlee.dev/api/playwright-crawler/interface/PlaywrightCrawlingContext#parseWithCheerio
robust-apricotOP•3y ago
Thank you!