Position Description:
Designs and implements data engineering solutions — Batch and Streaming Data Processing/Ingestion pipelines, Data Migration, Data Modeling, Data Analytics, and Artificial Intelligence/Machine Learning (AI/ML) model building. Leads Data Extraction, Transformation, and Loading (ETL) design and development process using data warehouse tools. Leads the modern DevOps practices for Continuous Integration/Continuous Delivery (CI/CD) implementation. Draws on in-depth knowledge of the business or function to provide business unit-wide solutions by developing complex, multi-faceted software applications. Researches and recommends new technologies in support of the strategic direction of the business unit and participates in the research and recommendation of appropriate models, methods, tools, and technologies to achieve business-unit-wide solutions.
Primary Responsibilities:
Crafts and implements operational data stores and data warehouses in multi-site High Availability environments. Leads, mentors, influences, and partners with architects, engineers, and product teams to deliver application solutions. Manages vendor relationships and drive issues to timely resolution. Develops Data engineering and analytics solutions and improves overall data and analytics usage across the product area and business groups. Collaborates with teams to provide technical recommendations and optimizes data access. Collaborates with leadership team to reduce technical debt and modernize applications. Translates and incorporates business vision and strategy to architectural strategy. Identifies and consults with internal and external technical resources to produce cross-company strategic designs. Consults on development and delivery of technology initiatives for the business unit. Consults on deployment of major project deliverables. Consults on the documentation of major technology application. Oversees the technical implementation of cross-divisional or company architectural components. Initiates and drives project or strategy discussions with users or external groups to resolve issues. Plans and leads organization-wide initiatives. Regularly provides guidance, training, and coaching to other team members for performance and career development. Identifies and plans for future resource needs. Determines technical approaches at a strategic level for the business unit.Education and Experience:
No degree and eight (8) years of experience as a Director, Software Engineering (or closely related occupation) performing Cloud data warehouse development, modeling, and design within the financial services industry.
Or, alternatively, Bachelor’s degree (or foreign education equivalent) in Computer Science, Engineering, Information Technology, Information Systems, Information Management, Business Administration, or a closely related field and six (6) years of experience as a Director, Software Engineering (or closely related occupation) performing Cloud data warehouse development, modeling, and design within the financial services industry.
Or, alternatively, Master’s degree (or foreign education equivalent) in Computer Science, Engineering, Information Technology, Information Systems, Information Management, Business Administration, or a closely related field and four (4) years of experience as a Director, Software Engineering (or closely related occupation) performing Cloud data warehouse development, modeling, and design within the financial services industry.
Skills and Knowledge:
Candidate must also possess:
Demonstrated Expertise (“DE”) designing and developing highly scalable Cloud data warehouses using public Cloud computing tools (Snowflake, AWS EC2, EMR, S3, and CloudFormation) and private Cloud computing tools (Hadoop, Hive, Map Reduce, and Sqoop); building Cloud native ETL processes using UNIX shell scripts, python snowflake connectors, Control-M, and Apache NiFi processors; extracting data from OLTP data stores/flat files and loading data into warehouse environment, using ETL processing, Informatica Power Center, and SQL*Loader; and designing and developing on-premise data storage solutions using IBM Netezza, Oracle, MS SQL server, and MS access. DE establishing inbound data cleansing capability system using Informatica Data Quality Management (IDQ); providing end-to-end visibility of Cloud data taxonomy and technical metadata catalog using Alation and Collibra; and designing, developing, and maintaining source code management and version control processes DevOps (Git-Hub, Jenkins Core, Enterprise uDeploy, Concourse, and Jira). DE developing Business Intelligence (BI) solutions using Oracle OBI, MS Power BI, Tableau, and universal semantic layer (Atscale); and designing large data sets and creating pre-aggregation to avoid data wrangling and inaccuracy in data, using Snowflake with data modelling patterns. DE designing and developing data security processes for public Cloud data stores using tokenization keys, Secure Hash Algorithms (SHA), Key vaults, and data security tools; implementing data security processes using role-based access (RBAC), Dynamic Row Level Security (RLS), and Active Directory S3 access management; integrating IBM Optim for data masking; and setting up Identity and Access Management (IAM) processes.#PE1M2
Certifications: