Houston, TX, 77007, USA
23 hours ago
Data Engineer
Description Are you a skilled Data Engineer with a passion for designing and implementing innovative data solutions in the cloud? Do you have hands-on expertise in Azure and experience with Medallion Architecture to optimize data processing pipelines? If so, we have an excellent opportunity for you to join a dynamic and forward-thinking team. As an Azure Data Engineer, you’ll play a pivotal role in creating and maintaining scalable, efficient, and high-quality data workflows that enable actionable business insights. You will collaborate with cross-functional teams to design data lakehouses leveraging Medallion Architecture, transforming raw data into analysis-ready datasets. Requirements Key Responsibilities + Design, develop, and maintain data pipelines and workflows in the Azure ecosystem, ensuring scalability, reliability, and performance across environments. + Implement Medallion Architecture principles (Bronze, Silver, Gold layers) for transforming raw data into standardized, curated, and business-trusted data layers. + Build, optimize, and manage data lakehouses using Azure Synapse Analytics, Azure Data Lake, and Delta Lake technologies. + Use tools such as Azure Data Factory (ADF), Synapse Pipelines, and Databricks to develop and automate data ingestion, transformation, and integration processes. + Collaborate with Data Scientists, Analysts, and business stakeholders to understand requirements and deliver datasets tailored to their needs. + Develop robust data models and schemas that ensure data integrity, security, and efficient query performance. + Manage metadata to ensure proper data lineage and governance protocols are followed. + Monitor, troubleshoot, and improve data pipelines to reduce latency and optimize costs. + Establish and enforce best practices for data engineering, including CI/CD pipelines, version control, and performance optimization. Required Skills and Qualifications + Proven experience as a Data Engineer working in cloud environments with Azure tools and services. + Strong understanding of Medallion Architecture and its application in modern data lakehouses. + Expertise with Azure Synapse Analytics, Data Lake, and Azure Databricks. + Proficient in Python, SQL, and PySpark for data processing and transformation. + Experience with Delta Lake for implementing ACID transactions and optimizing data lake workflows. + Hands-on experience with Azure Data Factory (ADF) or other orchestration tools for data ingestion and processing. + Ability to design and optimize data models, data partitions, and query performance in large-volume datasets. + Familiarity with CI/CD pipelines using tools like Azure DevOps or GitHub for managing ETL processes. + Strong understanding of data governance, data lineage, and security best practices. Technology Doesn't Change the World, People Do.® Robert Half is the world’s first and largest specialized talent solutions firm that connects highly qualified job seekers to opportunities at great companies. We offer contract, temporary and permanent placement solutions for finance and accounting, technology, marketing and creative, legal, and administrative and customer support roles. Robert Half works to put you in the best position to succeed. We provide access to top jobs, competitive compensation and benefits, and free online training. Stay on top of every opportunity - whenever you choose - even on the go. Download the Robert Half app (https://www.roberthalf.com/us/en/mobile-app) and get 1-tap apply, notifications of AI-matched jobs, and much more. All applicants applying for U.S. job openings must be legally authorized to work in the United States. Benefits are available to contract/temporary professionals, including medical, vision, dental, and life and disability insurance. Hired contract/temporary professionals are also eligible to enroll in our company 401(k) plan. Visit roberthalf.gobenefits.net for more information. © 2025 Robert Half. An Equal Opportunity Employer. M/F/Disability/Veterans. By clicking “Apply Now,” you’re agreeing to Robert Half’s Terms of Use (https://www.roberthalf.com/us/en/terms) .
Confirm your E-mail: Send Email