Sending requests to API causes timeout for 60 seconds

While using sendRequestsendRequest causes Reclaiming failed request back to the list or queue. requestHandler timed out after 60 seconds.Reclaiming failed request back to the list or queue. requestHandler timed out after 60 seconds.

Also, using PlaywrightCrawler with Proxy.

I am using following code (not same but similar):

{
nagivationTimeoutSecs: 300,
async requestHandler({ sendRequest }) {
  async function getData(page: number =   1) {
    const res = await sendRequest({
      url: "https://example.com/api/foo/bar",
      method: "GET",
    })

    if (res.next) await getData(page + 1)
  }

  await getData()
}
}

{
nagivationTimeoutSecs: 300,
async requestHandler({ sendRequest }) {
  async function getData(page: number =   1) {
    const res = await sendRequest({
      url: "https://example.com/api/foo/bar",
      method: "GET",
    })

    if (res.next) await getData(page + 1)
  }

  await getData()
}
}

Apify & Crawlee•4y ago•

4 replies

awake-maroon

Sending requests to API causes timeout for 60 seconds

{
nagivationTimeoutSecs: 300,
async requestHandler({ sendRequest }) {
  async function getData(page: number =   1) {
    const res = await sendRequest({
      url: "https://example.com/api/foo/bar",
      method: "GET",
    })

    if (res.next) await getData(page + 1)
  }

  await getData()
}
}

{
nagivationTimeoutSecs: 300,
async requestHandler({ sendRequest }) {
  async function getData(page: number =   1) {
    const res = await sendRequest({
      url: "https://example.com/api/foo/bar",
      method: "GET",
    })

    if (res.next) await getData(page + 1)
  }

  await getData()
}
}

Continue the conversation

Join the Discord to ask follow-up questions and connect with the community

A&C

Apify & Crawlee

This is the official developer community of Apify and Crawlee.

15,894 Members

Join

Sending requests to API causes timeout for 60 seconds

Sending requests to API causes timeout for 60 seconds

Continue the conversation

Apify & Crawlee

Continue the conversation

Apify & Crawlee

Similar Threads