Apify Discord Mirror

Updated 5 months ago

More actors in one repository

At a glance

The community member is considering having multiple Apify actors in a single repository (monorepo) for easier management and contribution. They ask if it's possible to connect these actors to the Apify platform and run them in different ways (e.g. command line parameters, environment variables, subfolders). The comments indicate that the community member found a relevant resource in the Apify documentation about actor monorepos, and they seem to have successfully implemented the solution.

Useful resources
I'm not that far in my proof of concept and perhaps I ask about something which would be clear later in my progress, but one question arises in my head when trying to architect my future solution.

I think I'd like to have many actors in one repository so it's easy to manage and contribute to them. But is it able to connect Apify actor with such (monorepo?) architecture?

E.g. I could have a Python package with a few scrapers to scrape jobs, then another package with a few scrapers to scrape meetup.com events, etc. Having them separated by topic and by setup (schedulers, proxies, etc.). But I'd like to have all scrapers in one repo.

In theory, would it be possible to have one repo with many actors, have many actor projects created in Apify GUI, and then somehow specify that particular Actor is being ran certain way (command line parameter, environment variable, subfolder, you name it)? What would be an idiomatic way to solve this?
L
H
A
4 comments
Awesome, thanks!
Attachment
sesame-street-ernie-bert.gif
just advanced to level 1! Thanks for your contributions! πŸŽ‰
I think I managed to get it working! πŸŽ‰
Add a reply
Sign up and join the conversation on Discord