I think scraping anything that requires
I think scraping anything that requires an account is pretty risky because it breaks terms and conditions. If the data is public (no login needed), the risk is much lower, but it’s still not zero there are other issues like copyright, personal data, the chance of hitting servers too hard (DDoS), and different laws that can come into play.
2 Replies
Yeah the fact is that even though most of the data that people want to scrape is actual people's data, the companies that have aggregated it have built their entire business models around aggregating it. However they have acquired it, that data is their moat and they will defend it.
Between us it would be dope to see an alliance of webscraping companies get together and challenge the private/public definitions of data at a legal level, especially as it pertains to personal and user-generated data. That would be such a boss move 😁
extended-yellow•11h ago
😯