JOB DESCRIPTION Lead Data Engineer
RESPONSIBILITIES/TASKS:
• Work with Technical Leads and Architects to analyse solutions.
• Translate complex business requirements into tangible data requirements through collaborative work with both business and technical subject matter experts.
• Develop / modify data models with an eye towards high performance, scalability, flexibility, and usability.
• Ensure data models are in alignment with the overall architecture standards.
• Create source to target mapping documentation.
• Subject matter knowledge guidance in source system analysis and ETL build.
• Responsible for overseeing data integrity in the Smart Conductor system.
• Serves as data flow and enrichment “owner” with deep expertise in data dynamics, capable of recognizing and elevating improvement opportunities early in the process.
• Work with product owners to understand business reporting requirements and deliver appropriate insights on regular basis.
• Responsible for system configuration to deliver reports, data visualizations, and other solution components.
SKILLS REQUIRED:
• More than 8 years of data engineering experience with minimum 4 years’ experience working on Azure Data Factory or SSIS
• Proficient and minimum 4 years’ working experience on Databricks and Delta Lake
• Proficient and minimum 2 years working experience with Azure cloud services and Azure blob storage & data lake.
• Very strong knowledge & working experience of SQL/TSQL
• Proficient in Python scripting
• Experience with RDBMS (MS SQL or Oracle 10g/11g), including database design, developing stored procedures and functions, and performance tuning.
• Strong working experiences with No-SQL databases like Azure Cosmos DB
• Experience in Azure SQL Server, Azure Synapse and Azure Synapse Analytics
• Understanding of Reporting and Data Visualization tools (PowerBI or SSRS)
• Experience in migrating systems from SSIS to Azure based systems.
• Experience within the healthcare insurance industry with payer data strongly preferred.
• Experience in data cleansing, data engineering, data enrichment, data warehousing/ Business Intelligence preferred.
• Strong analytical, problem solving and planning skills.
• Strong organizational and presentation skills.
• Excellent interpersonal and communication skills.
• Ability to multi-task in a fast-paced environment.
• Flexibility to adapt readily to changing business needs in a fast-paced environment.
• Team player who is delivery-oriented and takes responsibility for the team’s success.
• Enthusiastic, can-do attitude with the drive to continually learn and improve.
• Knowledge of Agile, SCRUM and/or Agile methodologies.