Key Duties/Tasks:
Design, develop, optimize, and maintain data architecture and pipelines that adhere to ETL principles and business goals. Collaborate with data engineers, data consumers, and other team members to produce simple, functional, and elegant solutions that balance the data needs across the organization. Solve complex data problems to deliver insights that helps the organization achieve its goals. Create data products that will be used throughout the organization. Advise, consult, mentor and coach other data and analytic professionals on data standards and practices. Develop and deliver documentation on data engineering capabilities, standards, and processes; participate in coaching, mentoring, design reviews and code reviews.Technical Qualifications:
5+ years relevant and progressive data engineering experience. Deep Technical knowledge and experience in Databricks, Python, Spark, Scala, AWS architecture and platform including Glue, Lambda pipelines etc. Hands-on experience working with data pipelines using a variety of source and target locations (e.g., Databricks, SQL Server, Data Lake, file-based, SQL and No-SQL database). Experience in engineering practices such as development, code refactoring, and leveraging design patterns, CI/CD, and building highly scalable data applications and processes. Experience developing batch ETL pipelines; real-time pipelines are a must. Knowledge of advanced data engineering concepts such as dimensional modeling, ETL, data governance, data warehousing involving structured and unstructured data. Thorough knowledge of SQL Server including T-SQL and stored procedures. Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.Diversity, Equity, Inclusion & Equal Employment Opportunity at ADP: ADP affirms that inequality is detrimental to our associates, our clients, and the communities we serve. Our goal is to impact lasting change through our actions. Together, we unite for equality and equity. ADP is committed to equal employment opportunities regardless of any protected characteristic, including race, color, genetic information, creed, national origin, religion, sex, affectional or sexual orientation, gender identity or expression, lawful alien status, ancestry, age, marital status, or protected veteran status and will not discriminate against anyone on the basis of a disability. We support an inclusive workplace where associates excel based on personal merit, qualifications, experience, ability, and job performance.
Ethics at ADP: ADP has a long, proud history of conducting business with the highest ethical standards and full compliance with all applicable laws. We also expect our people to uphold our values with the highest level of integrity and behave in a manner that fosters an honest and respectful workplace. Click https://jobs.adp.com/life-at-adp/ to learn more about ADP’s culture and our full set of values.