Jersey City, NJ, 07308, USA
43 days ago
Data Engineer
**The Scope** The Azure Cloud Engineer strategizes, designs, develops and work with a team of dynamic and passionate data engineers to deliver automated cloud infrastructure and DevOps solutions. The incumbent will play a key role in supporting the growth and scale of our Azure cloud-based technology infrastructure. This role is also responsible for complex interface process development, troubleshooting issues, supporting weekend maintenance and production support **Primary Responsibilities** PRIMARY RESPONSIBILITIES The job responsibilities are described herein: • Develop notebooks using Python, SQL, R language in Databricks • Databricks Cluster configuration, repository configuration. • Seamless integration with On-prem and cloud databases and Power BI reports • Build large-scale batch and real-time data pipelines with data processing frameworks in Azure cloud platform. • Partner with architects, engineers, information analysts, business, and technology stakeholders for developing and deploying platforms that enable data- driven solutions. • Provide technical guidance on technology implementation and architectural changes. • Sr. Azure Cloud Engineer coordinating with platform, APIM, Azure DevOps, and Support. • Analyze and design technical solutions on Azure to address business needs. • Develop, test, and modify software to improve efficiency of data platforms and applications. • Ability to own projects from end to end, working with business stakeholders, IT teams, data stewards, and 3rd party companies to ensure accurate outcomes. • Integrating data from a variety of sources, assuring that they adhere to data quality and accessibility standards. • Enable streaming data use-cases and standard design patterns in a big data environment. • Collaborating with data scientists to integrate algorithms and models into automated processes. • Review and provide feedback on core code changes and support production deployment. **Core Technologies** Azure databricks, Azure Data Factory, Azure Functions, Azure Data Lake storage, Azure Event Grid, Azure Log Analytics, Azure Monitor, Azure Service Bus, R, Python, SQL Server, Oracle / PL-SQL, T-SQL and SQL stored procedures, Azure DevOps **QUALIFICATIONS** + IT professional experience in Azure Cloud with over 5+ years of Azure Development + Ability to recreate existing legacy application logic and functionality into Azure Databricks/Data Lake, SQL Database and SQL Datawarehouse environment. + Excellent interpersonal and communication skills + Experience with software configuration management tools such as Git/Gitlab + Experience with continuous integration and deployment (CI/CD) tools such as Azure DevOps
Confirm your E-mail: Send Email