The Data Engineer is responsible for:

Developing and maintaining scalable data pipelines and builds out new API integrations to support continuing increases in data volume and complexity. Collaborating with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization. Implementing processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it. Writing unit/integration tests, contributing to engineering wiki, and documents work. Performing data analysis required to troubleshoot data related issues and assist in the resolution of data issues. Working closely with a team of frontend and backend engineers, product managers, and analysts. Defining company data assets (data models), spark, Informatica, Hadoop, sparkSQL, and hiveSQL jobs to populate data models. Designing data integrations and data quality framework. Designing and evaluating open source and vendor tools for data lineage. Working closely with all business units and engineering teams to develop strategy for long term data platform architecture.