Apify Discord Mirror

Updated 5 months ago

Expand clickable elements setting - Website Content Crawler

At a glance

The community member is trying to scrape content from the website https://www.msci.com/research-and-insights/, specifically trying to click the "load more" button to extract all the content. They have tried different approaches using CSS selectors, such as #research-items-load-more a, but the attempts have failed. One of the comments suggests using "actor Issues" instead, which only expands the content once, and the commenter will let the team know in the hopes of getting it upgraded.

Useful resources

ggautam

Hi there, I'm trying to scrape this website - https://www.msci.com/research-and-insights/, there's a load more button which I wish to click so that crawler extracts all the content.

I tried this setting in different ways but failing. The css selector for that element would be #research-items-load-more a . I tried setting values like ["#research-items-load-more a"=\"true\"] or just ['#research-items-load-more a']. It fails to run eventually.

Would appreciate quick help here.

2 comments

mmemo23

dm me

LLukas Krivka

Hello, please prefer using actor Issues next time.

It does expand it but only once. I will let the team know and hopefully it can me upgraded

Add a reply