Lead Data Engineer
Kforce
A client with Kforce is seeking a Lead Data Engineer to join their team remotely.
Summary:
As a Lead Data Engineer you will play a critical role in designing, developing, and maintaining our data infrastructure. You will work closely with the Data Lead and Technical Analyst to translate business requirements into technical solutions and ensure the seamless flow of data across our systems. You will be responsible for data integration, migration, and analysis using a variety of Microsoft technologies. This role requires a deep understanding of Azure Data Factory, Logic Apps, Azure Service Bus, Databricks, and advanced SQL.
Role:
* Absolute 100% hands on SME in Azure Data Factory and Data bricks and SQL
* Currently working in Unity Catalogue - needs to be very nimble here; This is important because this is how you control data bricks
Key Responsibilities:
* Design, develop, and maintain data pipelines using Azure Data Factory, Logic Apps, and Azure Service Bus
* Implement and manage Databricks for advanced data processing and analytics
* Develop complex SQL queries and stored procedures for data extraction, transformation, and loading (ETL)
* Collaborate with cross-functional teams to understand business requirements and translate them into technical specifications
* Ensure data quality and integrity across various data sources and systems
* Manage data integrations and migrations between diverse systems, ensuring minimal disruption to business operations
* Utilize Azure CI/CD pipelines for continuous integration and delivery of data solutions
* Create and maintain data workflows using Power Automate
* Conduct data analysis to support business decision-making processes
* Work independently and as part of a team to deliver high-quality data solutions
* Communicate effectively with stakeholders to understand their data needs and provide technical guidance
Confirm your E-mail: Send Email
All Jobs from Kforce