Apify & CrawleeA&CApify & Crawlee
Powered by
!!!Joefree!!! ๐Ÿ‘‘!
Apify & Crawleeโ€ข3y agoโ€ข
7 replies
!!!Joefree!!! ๐Ÿ‘‘

Dataset Info

Hi ! I want to show/log dataset statistic right after adding values using code below
            ## data => 1000-ish items

            # 100 records each to default dataset
            for i in range(0, len(data), 100): await Actor.push_data(data[i:i+100])
            
            # open default dataset
            ds = await Actor.open_dataset()
            
            # get info
            info = await ds.get_info()
            for k,v in info.items():
                print(k, v)
            ## data => 1000-ish items

            # 100 records each to default dataset
            for i in range(0, len(data), 100): await Actor.push_data(data[i:i+100])
            
            # open default dataset
            ds = await Actor.open_dataset()
            
            # get info
            info = await ds.get_info()
            for k,v in info.items():
                print(k, v)

the records added successfully, however the stats seems not updated immediately, shown in logs
itemCount = 0
itemCount = 0
:
2023-04-07T13:44:07.862Z id 8iukTelIPvlR7grEh
2023-04-07T13:44:07.864Z name None
2023-04-07T13:44:07.866Z userId ****
2023-04-07T13:44:07.868Z createdAt 2023-04-07 13:44:00.911000+00:00
2023-04-07T13:44:07.870Z modifiedAt 2023-04-07 13:44:00.911000+00:00
2023-04-07T13:44:07.871Z accessedAt 2023-04-07 13:44:02.891000+00:00
2023-04-07T13:44:07.873Z itemCount 0
2023-04-07T13:44:07.875Z cleanItemCount 0
2023-04-07T13:44:07.876Z actId O6knBihxFig55ve53
2023-04-07T13:44:07.878Z actRunId XrCVnyE7a6EXEbSv5
...
2023-04-07T13:44:07.881Z stats {'readCount': 0, 'writeCount': 0, 'storageBytes': 0}
2023-04-07T13:44:07.883Z fields []
2023-04-07T13:44:07.862Z id 8iukTelIPvlR7grEh
2023-04-07T13:44:07.864Z name None
2023-04-07T13:44:07.866Z userId ****
2023-04-07T13:44:07.868Z createdAt 2023-04-07 13:44:00.911000+00:00
2023-04-07T13:44:07.870Z modifiedAt 2023-04-07 13:44:00.911000+00:00
2023-04-07T13:44:07.871Z accessedAt 2023-04-07 13:44:02.891000+00:00
2023-04-07T13:44:07.873Z itemCount 0
2023-04-07T13:44:07.875Z cleanItemCount 0
2023-04-07T13:44:07.876Z actId O6knBihxFig55ve53
2023-04-07T13:44:07.878Z actRunId XrCVnyE7a6EXEbSv5
...
2023-04-07T13:44:07.881Z stats {'readCount': 0, 'writeCount': 0, 'storageBytes': 0}
2023-04-07T13:44:07.883Z fields []


do I missing something? any help greatly appreciated Thanks.
Apify & Crawlee banner
Apify & CrawleeJoin
This is the official developer community of Apify and Crawlee.
13,739Members
Resources

Similar Threads

Was this page helpful?
Recent Announcements
Recent Announcements
ellativity

**The Apify $1M Challenge is over!** For everyone who joined yesterdayโ€™s Award Ceremony livestream for the Apify $1M Challenge, thank you for your enthusiastic drumrolls in the chat and positive vibes. We were really feeling the excitement and celebratory mood! If you missed the stream or just want to rewatch the key moments again, hereโ€™s the replay link https://www.youtube.com/watch?v=eEDV-5X43Gg (ngl, the replay is not the same without your live chat) And, if you didnโ€™t check the email that should have landed in your inboxes, weโ€™d love to hear about your experience of participating in the Apify $1M Challenge. **<a:alerthulk:1468892073917939713> Win one of five $100 Visa gift cards by completing the end-of-challenge survey here: https://apify.typeform.com/to/mjoMaZqD** Thank you again to everyone who participated in any capacity. The past 3 months have been a wild ride and we feel so grateful to have been on this adventure with yโ€™all. We mean every word when we say how much youโ€™ve impressed us. Thank you all from the bottom of our hearts. <a:keanuthanks:1430839059655426068> Saurav and Ella xoxo PS - if you just want to jump to the spoilers, a full list of winners is available at https://apify.com/challenge ๐Ÿ†

ellativity ยท 4d ago

ellativity

**You are invited** ... to celebrate all the achievements of the Apify $1M Challenge with us on Wednesday, February 4 at **8 AM PT / 11 AM ET / 4 PM GMT / 5 PM CET / 9:30 PM IST / 12 AM +1d CST** We will be announcing winners of the Grand Prizes, as well as regional winners and much more, with especially good news for all participating developers. ๐Ÿ† We look forward to sharing with you all! ๐ŸŽ‰ More info here: https://luma.com/6c1493t0

ellativity ยท 2w ago

ellativity

Hi @everyone ๐Ÿ‘‹ I'm hanging out in https://discord.com/channels/801163717915574323/1430491198145167371 for the next 45 min, if you want to discuss the end of the challenge or anything else.

ellativity ยท 2w ago

Similar Threads

dataset retrieval via api - placeholder info
MEE6MMEE6 / apify-platform
3y ago
Dataset comparison
wet-aquaWwet-aqua / apify-platform
3y ago
Dataset schema view
JeromeJJerome / apify-platform
15mo ago
Dataset FIELDS attribute
!!!Joefree!!! ๐Ÿ‘‘!!!!Joefree!!! ๐Ÿ‘‘ / apify-platform
15mo ago