cold-orangeC
Apify & Crawlee3y ago
8 replies
cold-orange

How can I automatically get the dataset id from instagram post scraper into Merge, Dedup & Transform

As above, so im using the instagram post scraper once a week, and then i used to use code to get only the fields i needed. i only need 3 fields, then i push this in make (integromat) to do some automated tasks. But now the instagram post scraper has stopped allowing the code to remove the 100 values i dont need. So ive been advised to use Merge, Dedup & Transform Datasets to get the data into the needed format, but i cant work out how to get this all to run automatically?

So the flow would be, run instgram post scraper.
somehow get the dataset id from the sucessful run into Merge, Dedup & Transform Datasets
use that to remove all dataset item except 3
then fire the webhook into make

thanks!
Was this page helpful?