Experience: 10+ Years
Key Responsibilities
Design and develop scalable batch and real-time data pipelines on GCP.
Build and optimize ETL/ELT workflows using Dataflow and BigQuery.
Develop robust data processing applications using Java.
Implement data ingestion, transformation, validation, and monitoring frameworks.
Work closely with business stakeholders, architects, and analytics teams to understand data requirements.
Ensure high performance, scalability, security, and reliability of data platforms.
Optimize BigQuery performance and cost efficiency.
Participate in code reviews, debugging, troubleshooting, and production support activities.
Collaborate with cross-functional teams in Agile development environments.
Required Skills
Strong experience in Google Cloud Platform (GCP).
Hands-on expertise in: Dataflow, BigQuery ,Java
Strong knowledge of data engineering concepts, ETL pipelines, and distributed data processing.
Experience in handling large-scale structured and unstructured datasets.
Familiarity with cloud-native architecture and data warehousing concepts.
Strong SQL and performance tuning skills.
Experience with CI/CD pipelines and version control systems.
Excellent problem-solving and communication skills.
Good to Have:
Experience with Pub/Sub, Cloud Composer, or Dataproc.
Exposure to real-time streaming pipelines.
Knowledge of DevOps and Infrastructure as Code practices.
Experience working in Healthcare or BFSI domains.