Debug and troubleshooting Crawlee
When there is an error in the response-handler, then it does not show an error, but it will fail unnoticed, and Crawlee will retry 9 more times.
To illustrate the following syntax-error:
element = await context.page.query_selector('div[id="main"')
It should be with a closing bracket after "main":
element = await context.page.query_selector('div[id="main"]')
However, instead of failing, Crawlee will proceed and keep trying to query the page and it will not show any message on where it failed.
Is there any way to troubleshoot these kind of issues?
To illustrate the following syntax-error:
element = await context.page.query_selector('div[id="main"')
It should be with a closing bracket after "main":
element = await context.page.query_selector('div[id="main"]')
However, instead of failing, Crawlee will proceed and keep trying to query the page and it will not show any message on where it failed.
Is there any way to troubleshoot these kind of issues?
