AtlasLeads
Lightweight Playwright scraper that extracts business listings from Google Maps, enriches contacts by visiting the websites and exports to CSV and Excel. Educational project.
Educational · respect the Terms of ServiceAutomation · scraping2026
- Context and goal
- Collects name, address, website, phone, category, ratings and coordinates from search terms, with automatic per-city term generation using the IBGE API.
- Problem
- Build lists of businesses by niche and region in a reproducible way, in parallel and without repeating searches already done.
- Technologies
- pythonplaywrightpytestdockeribge api
01 / Architecture
Architecture
- cli
- query builder (ibge)
- maps scraper
- enrichment
- csv · xlsx
CLI
Orchestrates three flows: scrape, locations and queries.
Scraper
Google Maps via Playwright, with automatic handling of the consent dialog.
Enrichment
Visits each business's website and extracts additional emails and phone numbers.
IBGE
States, municipalities and population; combines cities × keywords into search terms.
02 / Decisions
Technical decisions
And the trade-off behind each one.
- Each search runs in its own process (ProcessPoolExecutor) with its own Chromium instance.
- Enrichment sub-pages fetched in parallel with ThreadPoolExecutor.
- --enrich-only mode to reprocess CSVs without repeating the search.
- Output organized by run date.
03 / Challenges
Challenges faced
To be written
What were the hard problems? What didn't work on the first try?
04 / Results
Results achieved
To be written
Measured results (time, cost, users, lessons learned). Prefer numbers.