Google Maps Scraper Question

At a glance

The community member is scraping Google Maps using the Compass tool and wants to scrape all restaurants in the state of California. They are unsure whether to just use "California" as the location or get a list of every city/place in California and run them individually. The community members are advised that using "California" will result in a deeper scrape of the top 500 cities and a shallower scrape elsewhere, which is a compromise between coverage and cost. The team is working on a more flexible way to determine the zooming. The community member is also provided a link to an orchestrator tool that allows inputting multiple locations and merging the results.

In the comments, the community member tried the orchestrator tool but found that it did not do a deep scrape, only getting a maximum of 120 results. The community member asked how to send the run link privately to get help, but there is no explicitly marked answer to this issue.

Useful resources

JJackoM8

Hello i'm scraping google maps using the compass tool. My question is lets say i want to scrape all restaurants in the state of california.

To do this would i just put “california” in the “location” field and then it will automatically scrape every single city place in the state of california also with the zooming feature on each individual place so it doesnt miss any.

Or

Am i better of getting a list of every place/city in california and running each one individually? And if this is the better way to do it to not miss any results then why is there not a way i can input multiple locations? As it is very time consuming having to go through run each location individually and download every output individually.

9 comments

JJackoM8

LLukas Krivka

Hello, for specific actor questions, please use the Issues tab next time.

Doing just California or inputing separate cities should have mostly similar results. If you do California, the scraper will internally find top 500 cities and do a deeper scrape there and shallow scrape elsewhere. There really isn't a "best" way to scrape, it is a compromise between coverage and cost by choosing good zoom based on the area (generally high zoom over cities and low over countryside)

The team is currently working on more flexible way of determining the zooming but it is still in progress.

You can input multiple locations and merge results with https://apify.com/lukaskrivka/google-maps-scraper-orchestrator

JJackoM8

Wow thanks

JJackoM8

This is perfect

JJackoM8

Ive done it the way you said and now it looks like its not doing a zoomed deep scrape as there is max i got a result of 120. I dont understand why it wouldnt work when its still going through the normal scraper when using the orchestrator

Attachment

LLukas Krivka

Can you send me your run link privately? I can check what happened

JJackoM8

How can i send you privately? I cant message you on discord

AApifyBot

just advanced to level 1! Thanks for your contributions! 🎉

LLukas Krivka

Trying to add you as a friend

Add a reply

Apify Discord Mirror

Google Maps Scraper Question