Role and Responsibilities:

10+ years of experience in Data Engineering role Developing and maintaining data pipelines for efficient data extraction, transformation, and loading (ETL) processes. Designing and optimizing data storage solutions, including data warehouses and data lakes. Ensuring data quality and integrity through data validation, cleansing, and error handling. Collaborating with Business Analysts, Data Analysts, Data Architects to understand data requirements and deliver relevant data sets. Implementing data security measures and access controls to protect sensitive information. Automating and improving data processes and workflows for scalability and efficiency. Monitoring data infrastructure for performance and reliability to address issues promptly. Documenting data pipelines, processes, and best practices for knowledge sharing. Providing technical support and mentoring to junior data engineers. Continuously optimizing data architecture to support the company's evolving data needs. Collaborating with cross-functional teams to drive data-driven decision-making within the organization.

Technical skills:

Strong knowledge of and experience in Datawarehouse, Data Lake, ETL frameworks, SQL, and No SQLExpertise in Databricks and Azure stack (ADF, ADLS, Synapse, AKV etc...)Strong programming skills in Python and PySparkStrong Experience in ETL/ELTProficiency in Data Modeling and Data ArchitectureSnowflake Experience (Optional)