Chennai, Tamil Nadu, India
3 days ago
Sr.Data Engineer
Data Architecture: Design, build, and optimize GCP-based data pipelines (streaming/Batch) using services like BigQuery, Dataflow, Dataproc, Pub/Sub, and Cloud Composer. Architect data lakes/warehouses for structured and unstructured data. Pipeline Development: Implement ETL/ELT workflows and integrate data from heterogeneous sources (APIs, databases, streaming platforms) using tools like Spark, Apache Beam, DBT, and Kafka. GCP Expertise: Proficiency in BigQuery, Dataflow, Dataproc, Cloud SQL, Pub/Sub , logging and monitoring. Programming: Strong coding skills in Python, SQL,Java and familiarity with Apache Spark DevOps & IaC: Experience with Terraform, Kubernetes, and CI/CD pipelines for infrastructure automation Data Modeling: Working Knowledge of relational, NoSQL (Bigtable, Firestore), and Vector databases. Governance & Compliance: Enforce data security, encryption, and governance standards (GDPR, CCPA) using GCP tools like Cloud KMS and IAM policies Collaboration: Partner with data scientists, DevOps, and business teams to deploy AI/ML models, BI dashboards (PowerBI ,Looker,Qlik), and real-time analytics solutions Operational Excellence: Automate CI/CD pipelines, monitor system performance, and troubleshoot issues using Terraform, Jenkins, and GCP monitoring tools
Confirm your E-mail: Send Email