The community member is asking if they can return results to a promise or callback when using the Crawlee SDK with the PlaywrightCrawler, or if they can only write to Datasets and retrieve the data later. The comments indicate that the community member can either push data to a Dataset or set values in a KV store, and that temporary results can be added to the userData in the request object. Another community member suggests using the useState feature of the BasicCrawler to store global state. One community member notes that Crawlee doesn't force the default data storage method, and the community member can override the push function or write their own callback. The community member also found a solution by referring to the Crawlee documentation on upgrading to version 3. Finally, some community members discuss the use of Datasets and how to loop through the results later in the code.
Am I reading correctly (and have tested) that returning results to a promise or a callback isn't an option with this SDK (crawlee w/ new PlaywrightCrawler() for example) ?
We can only write to Datasets and retrieve later for use?
Yes, either push data to dataset or set value in KV store (directly or by state management), everything else is out of SDK. Temp results might be added to userData in request object.
