AtlasLeads

Lightweight Playwright scraper that extracts business listings from Google Maps, enriches contacts by visiting the websites and exports to CSV and Excel. Educational project.

Educational · respect the Terms of ServiceAutomation · scraping2026
Context and goal
Collects name, address, website, phone, category, ratings and coordinates from search terms, with automatic per-city term generation using the IBGE API.
Problem
Build lists of businesses by niche and region in a reproducible way, in parallel and without repeating searches already done.
Technologies
pythonplaywrightpytestdockeribge api
01 / Architecture

Architecture

  1. cli
  2. query builder (ibge)
  3. maps scraper
  4. enrichment
  5. csv · xlsx
cli → query builder (ibge)cli → maps scrapermaps scraper → enrichmentenrichment → csv · xlsx

CLI

Orchestrates three flows: scrape, locations and queries.

Scraper

Google Maps via Playwright, with automatic handling of the consent dialog.

Enrichment

Visits each business's website and extracts additional emails and phone numbers.

IBGE

States, municipalities and population; combines cities × keywords into search terms.

02 / Decisions

Technical decisions

And the trade-off behind each one.

  • Each search runs in its own process (ProcessPoolExecutor) with its own Chromium instance.
  • Enrichment sub-pages fetched in parallel with ThreadPoolExecutor.
  • --enrich-only mode to reprocess CSVs without repeating the search.
  • Output organized by run date.
03 / Challenges

Challenges faced

To be written

What were the hard problems? What didn't work on the first try?

04 / Results

Results achieved

To be written

Measured results (time, cost, users, lessons learned). Prefer numbers.