We are seeking a highly skilled Senior Data Engineer with extensive experience in designing, building, and optimizing high-volume data pipelines. The ideal candidate will have strong expertise in Python, Databricks on Azure Cloud services, DevOps/data factory, and CI/CD tools, along with a solid understanding of AI/ML techniques and big data processing frameworks like Apache Spark and PySpark. Responsibilities: Adhere to coding and Numerator technology standards  Build suitable automation test suites within Azure data factory Maintain and update automation test suites as required  Carry out manual testing, load testing, exploratory testing as required  Work closely with Business Analysts and Senior Developers to consistently achieve sprint goals  Assist in estimation of sprint-by-sprint stories and tasks  Pro-actively take a responsible approach to product delivery