Data Engineer

Role Overview:

As a Data Engineer, you will design, build, and maintain robust data pipelines and systems to support our analytics and business intelligence initiatives.

You will work closely with other engineers to ensure the seamless flow and accessibility of high-quality data across the organization.

Your expertise will drive data architecture decisions, optimize performance, and contribute to the success of data-driven projects.

Additionally, you will collaborate with Analysts, Engineers, Architects and stakeholders to ensure data is effectively utilized for generating insights and informing strategic decisions.

Key Responsibilities:

Design, develop, and manage scalable data pipelines to process and transform large datasets from multiple sources.

Build and maintain data models, warehouses, and data lakes to support analytical and reporting needs.

Collaborate with stakeholders to understand data requirements and ensure alignment with business goals.

Implement data quality and governance standards, including monitoring and validation processes.

Optimize data storage, retrieval, and processing performance across the infrastructure.

Mentor data engineers, providing technical guidance and fostering professional growth.

Work with Analysts, Engineers, Architects and stakeholders to provide clean and reliable data for analysis and reporting.

Create reports and dashboards using visualization tools (e.g., Tableau, Power BI).

Ensure data integrity and accessibility for analytical use cases.

Collaborate on developing and maintaining key performance indicators (KPIs) and metrics for business insights.

Assist in troubleshooting data-related issues encountered

Analyzing requirements and perform technical feasibility study/analysis
Developing integrations using SQL on our RDBMS database
Being a technical advisor for production issues
Assisting/developing the Testing Automation Strategies
Carrying out Unit Test and System Integration Testing
Supporting audits with documentation/proofs/runthrough the code base
Using CI/CD pipeline to implement the solution
Communicating with the stakeholders to analyse and understand the need and design the solution accordingly
Using advanced SQL query language to support data integration
Supporting other squad members whenever needed with your experience and knowledge

Required Skills and Qualifications:

Bachelor’s in Computer Science, Engineering, or a related field.

3 - 5 years of experience in data engineering or a similar role.

Proficiency in programming languages such as Python, Java, or Scala.

Expertise in SQL and experience with relational and non-relational databases (e.g., Oracle,PostgreSQL, MySQL, MongoDB).

Familiarity with containerization and orchestration tools (e.g., Docker, Kubernetes).

Excellent problem-solving skills and ability to work independently in a fast-paced environment.

Agile / Scrum methodologies.
CI / CD tooling: Azure DevOps, Git, Ansible
Issue trackers like ServiceNow or Azure Boards
Ability to communicate effectively and present/demo ideas and solutions
Data modelling, Data processing techniques

Keen on documenting her/his work

Preferred Skills:

Experience with machine learning workflows and tools.

Knowledge of CI/CD pipelines and DevOps practices.

Familiarity with data visualization tools (e.g., Tableau, Power BI).