Job Summary

We are seeking an experienced Big Data Engineer with strong expertise in Google Cloud Platform (GCP) and BigQuery to design, develop, and maintain scalable data solutions. The ideal candidate will have hands-on experience building data pipelines, optimizing large-scale datasets, and implementing cloud-native data architectures.

______________

Key Responsibilities

• Design, develop, and maintain scalable data pipelines on GCP
• Build and optimize data warehouses using BigQuery
• Implement ETL/ELT processes using tools such as:

o Cloud Dataflow

o Cloud Composer (Airflow)

o Cloud Functions

• Develop batch and real-time data processing solutions
• Optimize SQL queries and improve BigQuery performance and cost efficiency
• Implement data modeling techniques (star schema, snowflake schema, partitioning, clustering)
• Work with structured and semi-structured data (JSON, Avro, Parquet)
• Ensure data quality, governance, and security best practices
• Collaborate with data scientists, analysts, and business stakeholders
• Monitor pipelines and troubleshoot production issues
• Implement CI/CD for data workflows

______________

Required Skills & Qualifications

Technical Skills

• Strong experience with Google Cloud Platform (GCP)
• Expert-level knowledge of BigQuery
• Proficiency in SQL (advanced query optimization)
• Hands-on experience with:

o Dataflow

o Pub/Sub

o Cloud Storage

o Cloud Composer (Airflow)

• Experience with Python and/or Scala
• Experience designing data lakes and data warehouses
• Familiarity with IAM, security, and access control in GCP
• Experience with API integrations and streaming data