Azure Databricks Data Engineer

Data Architect I

 

Who We Are:

Born digital, UST transforms lives through the power of technology. We walk alongside our clients and partners, embedding innovation and agility into everything they do. We help them create transformative experiences and human-centered solutions for a better world. 

UST is a mission-driven group of over 39,000+ practical problem solvers and creative thinkers in over 30+ countries. Our entrepreneurial teams are empowered to innovate, act nimbly, and create a lasting and sustainable impact for our clients, their customers, and the communities in which we live.

With us, you’ll create a boundless impact that transforms your career—and the lives of people across the world.

Visit us at UST.com.

 

You Are:

UST is looking for an experienced Data Engineer with a proven track record of driving product success from an engineering perspective. We are looking for someone who has strong experience in building scalable and reliable data pipelines using Databricks and Spark. You will be working with various data sources and formats and transforming them into valuable insights for our business.

 

The Opportunity:

·       Holistic Learning: Dive into the intricacies of our platform, mastering its ins and outs.

·       Strategic Contributions: Design, develop, and maintain data pipelines using Databricks and Spark, and other cloud technologies as needed.

·       Hands-On Contribution: Tackle challenging tasks as a hands-on contributor, ensuring a seamless transition between various facets of this dynamic role throughout the workday.

·       Optimize data pipelines for performance, scalability, and reliability.

·       Ensure data quality and integrity throughout the data lifecycle.

·       Collaborate with data scientists, analysts, and other stakeholders to understand and meet their data needs.

·       Troubleshoot and resolve data-related issues and provide root cause analysis and recommendations.

·       Document data pipeline specifications, requirements, and enhancements, and communicate them effectively to the team and management.

·       Create new data validation methods and data analysis tools and share best practices and learnings with the data engineering community.

·       Implement ETL processes and data warehouse solutions and ensure compliance with data governance and security policies.

 

This position description identifies the responsibilities and tasks typically associated with the performance of the position. Other relevant essential functions may be required.

 

What you need:

·       Bachelor’s degree in Computer Science, Engineering, or related field, or equivalent work experience

·       8+ years of experience in data engineering, preferably with Databricks and Spark

·       Proficient in SQL and Python, and familiar with Java or Scala

·       Experience with cloud platforms, preferably Azure

·       Experience with data warehouse and data lake concepts and architectures

·       Experience with data integration and ETL tools, preferably Azure Data Factory

·       Strong analytical and problem-solving skills

·       Excellent communication and teamwork skills

·       Nice-to-Have:

o   Experience with big data technologies, such as Kafka, Hadoop, Hive, etc.

o   Experience with data visualization and reporting tools, preferably Tableau

 

 

What we believe:

We’re proud to embrace the same values that have shaped UST since the beginning. Since day one, we’ve been building enduring relationships and a culture of integrity. And today, it's those same values that are inspiring us to encourage innovation from everyone to champion diversity and inclusion, and to place people at the center of everything we do. 

Humility:

We will listen, learn, be empathetic and help selflessly in our interactions with everyone.

Humanity:

Through business, we will better the lives of those less fortunate than ourselves.

Integrity:

We honor our commitments and act with responsibility in all our relationships.

 

Equal Employment Opportunity Statement

UST is an Equal Opportunity Employer.

 

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

UST reserves the right to periodically redefine your roles and responsibilities based on the requirements of the organization and/or your performance.

 

#UST

#LI-SP4