dataset.getData(offset, limit) throws error
Hi everyone,
I'm looping over a dataset and retrieving items in batch using dataset.getData(offset, limit) but my process seems to crash randomly with the following error:
items.push(await existingStoreById.datasetEntries.get(entryNumber).get());
TypeError: Cannot read properties of undefined (reading 'get') at DatasetClient.listItems (/home/crawleruser/node_modules/@crawlee/memory-storage/resource-clients/dataset.js:140:79) at async Dataset.getData (/home/crawleruser/node_modules/@crawlee/core/storages/dataset.js:220:20)
Does anyone know what might be causing this?
I'm using Crawlee 3.3.3
I'm looping over a dataset and retrieving items in batch using dataset.getData(offset, limit) but my process seems to crash randomly with the following error:
items.push(await existingStoreById.datasetEntries.get(entryNumber).get());
TypeError: Cannot read properties of undefined (reading 'get') at DatasetClient.listItems (/home/crawleruser/node_modules/@crawlee/memory-storage/resource-clients/dataset.js:140:79) at async Dataset.getData (/home/crawleruser/node_modules/@crawlee/core/storages/dataset.js:220:20)
Does anyone know what might be causing this?
I'm using Crawlee 3.3.3
