Want to scrap multiple elements on a web page

import { PlaywrightCrawler } from "crawlee";

const crawler = new PlaywrightCrawler({
  requestHandler: async ({ page, request, enqueueLinks }) => {
    console.log(`Processing: ${request.url}`);
    console.log(request.label);

    const title = await page
      .locator("span.nm-collections-row-name")
      .textContent();

    const results = {
      title,
    };

    console.log(results);
  },

  // Let's limit our crawls to make our tests shorter and safer.
  maxRequestsPerCrawl: 20,
});

await crawler.run(["https://www.netflix.com/in/browse/genre/1191605"]);

import { PlaywrightCrawler } from "crawlee";

const crawler = new PlaywrightCrawler({
  requestHandler: async ({ page, request, enqueueLinks }) => {
    console.log(`Processing: ${request.url}`);
    console.log(request.label);

    const title = await page
      .locator("span.nm-collections-row-name")
      .textContent();

    const results = {
      title,
    };

    console.log(results);
  },

  // Let's limit our crawls to make our tests shorter and safer.
  maxRequestsPerCrawl: 20,
});

await crawler.run(["https://www.netflix.com/in/browse/genre/1191605"]);

This is the code. Since there are multiple span tags in the web page so it is showing error. I want to get all the span tags. Can anyone help me

Apify & Crawlee•2y ago•

5 replies

primary-violet

Want to scrap multiple elements on a web page

import { PlaywrightCrawler } from "crawlee";

const crawler = new PlaywrightCrawler({
  requestHandler: async ({ page, request, enqueueLinks }) => {
    console.log(`Processing: ${request.url}`);
    console.log(request.label);

    const title = await page
      .locator("span.nm-collections-row-name")
      .textContent();

    const results = {
      title,
    };

    console.log(results);
  },

  // Let's limit our crawls to make our tests shorter and safer.
  maxRequestsPerCrawl: 20,
});

await crawler.run(["https://www.netflix.com/in/browse/genre/1191605"]);

import { PlaywrightCrawler } from "crawlee";

const crawler = new PlaywrightCrawler({
  requestHandler: async ({ page, request, enqueueLinks }) => {
    console.log(`Processing: ${request.url}`);
    console.log(request.label);

    const title = await page
      .locator("span.nm-collections-row-name")
      .textContent();

    const results = {
      title,
    };

    console.log(results);
  },

  // Let's limit our crawls to make our tests shorter and safer.
  maxRequestsPerCrawl: 20,
});

await crawler.run(["https://www.netflix.com/in/browse/genre/1191605"]);

This is the code. Since there are multiple span tags in the web page so it is showing error. I want to get all the span tags. Can anyone help me

Continue the conversation

Join the Discord to ask follow-up questions and connect with the community

A&C

Apify & Crawlee

This is the official developer community of Apify and Crawlee.

14,290 Members

Join

Want to scrap multiple elements on a web page

Want to scrap multiple elements on a web page

Continue the conversation

Apify & Crawlee

Continue the conversation

Apify & Crawlee

Similar Threads