GCP Data Engineer

A Leading Cloud Technology Firm is seeking a delivery-minded GCP Data Engineer at the Senior Engineer level to build scalable data platforms in Hyderabad or Pune. In this technical engineering role, you will design and develop enterprise data pipelines utilizing Google Cloud Platform services such as BigQuery, Dataflow, Pub/Sub, and Cloud Storage. Furthermore, you will build scalable ETL/ELT workflows using Python, PySpark, and SQL, while orchestrating DAGs using Apache Airflow. Consequently, this role is crucial for delivering trusted data models and analytics.

The GCP Data Engineer must combine extensive hands-on experience in distributed data processing with a solid understanding of cloud data architecture and security practices. Collaborating closely with analytics, product, and data science squads, you will optimize data transformations for maximum performance and cost efficiency. Therefore, the group is looking for a proactive problem-solver who implements data governance frameworks seamlessly. If you want to engineer high-throughput cloud data pipelines, this position is for you.

Key Responsibilities

• Design, build, and maintain scalable, secure ETL/ELT data pipelines utilizing Google Cloud Platform (GCP) services.
• Develop high-performance batch and streaming transformations using Python, PySpark, BigQuery, and Cloud Dataflow.
• Implement, manage, and schedule complex workflow orchestration DAGs using Apache Airflow.
• Ingest and process real-time and batch data streams using GCP Pub/Sub and Google Cloud Storage.
• Create optimized relational and dimensional data models to support enterprise reporting and business intelligence.
• Perform query optimization, pipeline tuning, and performance monitoring across large-scale BigQuery datasets.
• Embed enterprise data architecture standards, data governance policies, and IAM security controls into pipelines.
• Partner with cross-functional analytics, data science, and product squads to deliver reliable data-driven solutions.

Requirements and Qualifications

• Graduate or Postgraduate degree in Computer Science, Data Engineering, Information Technology, or a related branch.
• 6+ Years of dedicated hands-on experience in Data Engineering utilizing Google Cloud Platform (GCP) technologies.
• Deep technical expertise in GCP core services: BigQuery, Cloud Dataflow, Pub/Sub, and Cloud Storage.
• Advanced programming skills in Python and PySpark for distributed data transformation and pipeline construction.
• Demonstrated proficiency in Apache Airflow orchestration, complex SQL querying, and cloud data modeling.