conventional-blackC
Apify & Crawlee•2y ago
conventional-black

Not sure if this is a feature request,

Not sure if this is a feature request, but it's an idea I implemented and there doesn't seem to be a better channel for general chatting.

When using Scrapy, there's this concept of Items. I was able to extend Items so that they contain declarative specification of Apify input types (see code):

class ExchangeRate(Item):
    code = Field()
    rate = Field(apify_format="number")


Then I go through these classes and generate output schemas for Apify datasets automatically:

Perhaps this is too specific to my project, perhaps this can inspire someone to simplify their workflow.
Was this page helpful?