equal-aqua•3y ago

Is it possible to stream scraping results as they become available?

I want to scrape a lot of data and don't want to wait for the actor to finish running before being able to use the data

4 Replies

Hey! I don't think that's currently possible. You can however theoretically create an actor that would periodically query for the items in the dataset once the scraping starts

equal-aquaOP•3y ago

what does that mean? Is there a way to poll the actor for data while it's running? @lemurio

lemurio•3y ago

yes, you can do it using the API or client for JS/Python

equal-aquaOP•3y ago

thanks

Is it possible to stream scraping results as they become available?

Did you find this page helpful?