Flask/Python Developer for Automated Data Collection

We're building a private deal flow platform for a small PE/acquisition firm. The backend is Python/Flask running on Ubuntu, and the data collection layer needs fixing and extending.

What we need done:

The scope is clearly defined — fix unreliable scrapers for 6 specific business listing sites, add deduplication logic, wire up the existing scheduler, and investigate whether any of the target sites offer official APIs worth using instead of scraping.

All existing architecture and endpoints are already built. This is purely scraping and integration work, no frontend or database changes needed.

Skills required:

Python, web scraping (BeautifulSoup, Playwright or Selenium), experience handling JavaScript-rendered pages and basic bot detection, REST API integration.

How we work:

Small team. We'll share the existing codebase upfront so you can review before finalizing your quote.

We expect a short written summary at the end noting which sources were reliable, which were problematic, and your API vs.

scraping recommendation for each.

Communication:

We're straightforward to work with. Flag any blockers early rather than going quiet. A quick check-in halfway through is appreciated.

This is a fixed price engagement with potential follow-on work for the right person.

Contract duration of less than 1 month.

Mandatory skills:

Python Web Scraping, BeautifulSoup, REST API Development, Selenium, Python