Job Description A large agricultural client is seeking an Azure Data Engineer to join a team that is revamping the companys data management toolkit. The team was brought into design and build a new C# based web application and establish associated Azure Data Factory pipelines to streamline and integrate all client data in a one stop shop. The current priority is fulfill client requirements and get the overall user flow through the solution in a stable place for user testing. The team must address additional gaps and bugs, amending pipelines to ensure data integrity at all stages of the user flow, and developing/validating test cases against user requirements. Other Responsibilities Include:  Utilization of Azure for data engineering tasks  Monitor and troubleshoot data integration processes to ensure data accuracy and completeness.  Design, build, and maintain scalable and efficient data pipelines and infrastructure.  As part of a development team, collaborate with teammates to understand data requirements and implement appropriate data storage and processing solutions.  Ensure data availability, integrity, and security.  Identify and implement data quality checks, error handling, and data validation procedures.  Develop and optimize data processing workflows to support efficient data analysis and reporting.  Implement data transformation and aggregation techniques to enable faster and more accurate analytics.  Implement data security measures and access controls to protect sensitive data.  Develop and maintain documentation for data sources, data flows, and data processes.  Identify and resolve performance bottlenecks in data processing and storage systems.  Conduct performance tuning and optimization of data pipelines and databases.  Monitor and analyze system performance metrics to proactively identify areas for improvement.  Design, build, debug data pipelines in Azure Data Factory. Pay ranges $58/hr to $68/hr We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com .     To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ . Skills and Requirements - 7+ years of data engineering experience - Experience building and maintain data pipelines in Azure Data Factory - Proficiency in working with relational databases (e.g., SQL) databases. - Experience with data visualization tools (e.g., Tableau, Power BI) null We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to HR@insightglobal.com.