Vverbal-lime
Deploying Crawlee in Self-hosted Servers
Hello, I'm quite new in using crawlee and scraping using javascript in general. I have experience in using python for creating medium scale scraping (multiple playwright browser orchestrated by airflow). Is there any analogue for this in js/node ecosystem, or the more node-ish way of orchestrating multiple crawler in self-hosted server?
For now the options that I can think of is Wraping the script using express js and hitting it with API call periodically (like cron/ airflow). Is there any better way of doing this?
* I've tried searching for scaling/deploy in the forum but haven't found any that I could understand and implement
For now the options that I can think of is Wraping the script using express js and hitting it with API call periodically (like cron/ airflow). Is there any better way of doing this?
* I've tried searching for scaling/deploy in the forum but haven't found any that I could understand and implement
