Python Developer (Web Scraping & Data Processing)

As a Python Developer specializing in Web Scraping and Data Processing at Riverstone Investors, you will play a crucial role in leveraging your expertise in Python programming and data extraction techniques to gather, process, and analyze complex datasets. Your work will empower data-driven decision-making across various business functions, ensuring high-quality insights and operational efficiency.

Responsibilities

• Develop and maintain robust web scraping tools using Python to extract data from diverse online sources efficiently and accurately.
• Design, implement, and optimize ETL (Extract, Transform, Load) pipelines to process large volumes of structured and unstructured data.
• Collaborate with cross-functional teams to understand data requirements and translate them into scalable technical solutions.
• Apply advanced analysis skills to identify patterns, anomalies, and insights within datasets.
• Support model training initiatives by preparing datasets and automating data collection processes for machine learning projects.
• Develop, maintain, and optimize web scraping scripts using Selenium.
• Monitor and troubleshoot existing scraping workflows when source website structures change.
• Update and refactor code to ensure consistent data extraction despite frequent site changes.
• Process, clean, and organize scraped data using Pandas.
• Ensure data accuracy, consistency, and reliability across datasets.
• Collaborate with team members to identify issues and implement improvements quickly.
• Work independently with minimal supervision while meeting tight deadlines.

Requirements

• Proven experience with Python programming, especially in web scraping libraries such as BeautifulSoup or Scrapy.
• Knowledge of ETL tools including Talend or Informatica for efficient data integration workflows.
• Hands-on experience with Selenium for web automation and scraping.
• Solid experience using Pandas for data manipulation and analysis.
• Good understanding of HTML, DOM structure, and handling dynamic web content.
• Experience debugging and maintaining existing codebases.
• Ability to quickly identify and fix issues caused by changes in source websites.
• Strong problem-solving skills and attention to detail.

Required Qualifications:

• Four-year degree in computer science or related field.
• 3-5 years of experience working in Python-related projects.
• Experience with headless browsers and automation tools.
• Familiarity with proxies, CAPTCHA handling, and anti-bot mechanisms.
• Knowledge of version control systems (e.g., Git).
• Experience working in remote or distributed teams.

In this role, you will be expected to work in a quick-paced and execution-focused environment with immediate impact from day one. You will have the opportunity to work on real-world data challenges and scalable scraping systems. This position is a direct hire with no third-party applicants or agency involvement.

Job Types: Full-time, Contractual / Temporary

Pay: 1,000,000.00 - 1,453,058.84 per year

Application Question(s):

• What is your experience in using Selenium and Pandas within Python
• What is your experience with web/data extraction projects Specifically extracting data from websites and creating an organized CSV of data pulled

Experience

• Python: 3 years (Required)

Language:

• English (Required)

Work Location: Remote As a Python Developer specializing in Web Scraping and Data Processing at Riverstone Investors, you will play a crucial role in leveraging your expertise in Python programming and data extraction techniques to gather, process, and analyze complex datasets. Your work will empower data-driven decision-making across various business functions, ensuring high-quality insights and operational efficiency.

Responsibilities

• Develop and maintain robust web scraping tools using Python to extract data from diverse online sources efficiently and accurately.
• Design, implement, and optimize ETL (Extract, Transform, Load) pipelines to process large volumes of structured and unstructured data.
• Collaborate with cross-functional teams to understand data requirements and translate them into scalable technical solutions.
• Apply advanced analysis skills to identify patterns, anomalies, and insights within datasets.
• Support model training initiatives by preparing datasets and automating data collection processes for machine learning projects.
• Develop, maintain, and optimize web scraping scripts using Selenium.
• Monitor and troubleshoot existing scraping workflows when source website structures change.
• Update and refactor code to ensure consistent data extraction despite frequent site changes.
• Process, clean, and organize scraped data using Pandas.
• Ensure data accuracy, consistency, and reliability across datasets.
• Collaborate with team members to identify issues and implement improvements quickly.
• Work independently with minimal supervision while meeting tight deadlines.

Requirements

• Proven exper