Role Overview
Zorba AI is hiring a mid-level Python Pyspark_5+years. This is a full-time role in IN. posted last week. Full responsibilities, required qualifications, and the apply link are listed in the description below.
Resume Keywords to Include
Make sure these keywords appear in your resume to improve ATS scoring
Job Description
Job Summary
We are seeking an experienced Python Data Engineer with strong expertise in building scalable data pipelines and processing large datasets using Python, PySpark, SQL, and Databricks. The ideal candidate should have hands-on experience with Azure cloud services, Azure Data Lake Storage, ETL development, and DevOps practices. The role involves designing, developing, and optimizing data solutions that support business intelligence, analytics, and data-driven decision-making.
Key Responsibilities
- Design, develop, and maintain robust and scalable data pipelines using Python and PySpark.
- Build and optimize ETL/ELT processes for ingesting, transforming, and loading large volumes of structured and unstructured data.
- Develop data processing solutions using Python libraries such as Pandas, NumPy, and PySpark.
- Leverage Databricks to implement and manage data engineering workflows and solve complex business problems.
- Work with Azure Data Lake Storage (ADLS) and other Azure cloud services to manage and process data efficiently.
- Write complex SQL queries, stored procedures, and scripts for data extraction, transformation, validation, and reporting.
- Collaborate with cross-functional teams including Data Analysts, Data Scientists, Architects, and Business Stakeholders to understand data requirements.
- Monitor, troubleshoot, and optimize data pipelines for performance, scalability, and reliability.
- Implement data quality checks, governance standards, and security best practices.
- Participate in code reviews and ensure adherence to development standards and best practices.
- Support CI/CD implementation and deployment activities following DevOps methodologies.
Required Skills & Qualifications
- 5–8+ years of hands-on experience in Python development and data engineering.
- Strong programming expertise in Python.
- Experience with Python libraries such as Pandas, NumPy, and PySpark.
- Strong knowledge of SQL and database concepts.
- Hands-on experience with Databricks and Spark-based data processing.
- Experience with Azure Cloud services and Azure Data Lake Storage (ADLS).
- Solid understanding of ETL/ELT concepts and data warehousing principles.
- Experience working with large-scale datasets and distributed computing frameworks.
- Working knowledge of DevOps practices, CI/CD pipelines, Git, and deployment automation.
- Strong analytical, problem-solving, and debugging skills.
- Excellent communication and stakeholder management skills.
Preferred Skills
- Experience with Azure Data Factory (ADF), Azure Synapse Analytics, or other Azure data services.
- Knowledge of Delta Lake and Medallion Architecture.
- Exposure to data governance, data security, and cloud-native architectures.
- Experience in Agile/Scrum development environments.
Education
- Bachelor’s or Master’s degree in Computer Science, Information Technology, Engineering, or a related field.
Skills: pyspark,python,databricks
Frequently Asked Questions
How do I apply for the Python Pyspark_5+years position at Zorba AI?
Use the Apply button above to submit your application directly to Zorba AI. Most applications take less than 5 minutes if your resume and contact details are ready, and you'll be routed to the employer's official application system to finish.
Where is the Python Pyspark_5+years position at Zorba AI located?
This position is based in IN. Zorba AI has not indicated remote or hybrid options for this role, so candidates should plan for on-site work.
What does a Python Pyspark_5+years at Zorba AI earn?
Zorba AI has not disclosed a salary range in this posting. Many employers share specifics later in the interview process; you can also ask during a recruiter screen if compensation transparency is important to you.
When was the Python Pyspark_5+years role at Zorba AI posted?
This role was posted on June 16, 2026 (8 days ago). It's still listed as actively hiring; we re-confirm openings against the source system multiple times per day and remove closed roles.
AI-powered job search
Get every job scored to your resume
Upload your resume and get jobs ranked, your resume tailored, and employee contacts found automatically.
Get Started FreeNo credit card to start