quickest-silver•2y ago
How to bulk download content from the key-value store?
Hi community! I used the TikTok scraper to get some videos and now they are stored i nmy key-value store. There I only see how to download them one by one ... but acutally I would like to download them all at once. Can anybody let me know if this is possible and how?
7 Replies
I guess, there is no way to get all at once.
Only separately, one by one.
I know that there is this Actor https://apify.com/vaclavrut/downloadkvstorezip but not sure if it is still working.
Apify
Zip Download of KV Store · Apify
Creates a zip file from all items in the key-value store, zips them, and downloads them in a unique file. On input, you can specify the number of the files or keep it null to download them all. The key-value store must be under your Apify account.
@Pepa J
Thanks. Yeah, I tried to use some time ago but didn't succeed. I guess it's too old and requires some updates.
But @judgereini You can give it a try ofc.
equal-aqua•2y ago
It should be easy if you write a script. Access the kv store then using the .list method you can get all the keys and download them all.
quickest-silverOP•2y ago
Hi guys! Thanks for the replies! I've found an actor that did everything I needed :-)))
quickest-silverOP•2y ago
Zip Key-value Store
https://apify.com/jaroslavhejlek/zip-key-value-store
Apify
Zip Key-value Store · Apify
Takes the ID of the key-value store, archives all their keys into a zip file, and saves them into the key-value store of the actor. For more than 1000 keys, multiple zip files are created. If their total size is bigger than the actor's available memory, it creates multiple smaller zip files.
quickest-silverOP•2y ago
I tried this, too. But this one didn't work.