Dublin, IRL
1 day ago
SRE Data Engineer
**Introduction** This role is responsible for designing, deploying, and maintaining our infrastructure, data processing application and CI/CD pipelines with large volumes of data. The position will be part of the SRE Data team and will primarily work with R&D, SRE and Data analysts. The work includes designing, building and deploying high availability, robust, resilient and supportable big data solutions while streamlining and automating our software delivery and infrastructure operations in a large-scale SaaS environment. With a focus on the infrastructure and operational elements of designing and deploying ETL big data solutions, the SRE Data Engineer must ensure the infrastructure is highly available, has sufficient capacity, and is fully resilient across multiple data centres and cloud architectures. **Your role and responsibilities** * Develop and maintain automation scripts and tools using Python, Groovy. * Create and manage our pipelines, CI/CD infrastructure and automation jobs in Jenkins. * Manage with Terraform Development/QA/Production environments * Perform data pipelines and ETL process health monitoring and diagnostics. * Integrate monitoring, auditing, and alert systems for databases with existing monitoring infrastructure. * Occasional off-shift availability to resolve Production issues * Work closely with other members of the SRE and R&D teams * Responsible for system performance and reliability. * Ensure proactive engagement in the Incident Management process, working with Operational teams to minimize the impact of database outages. **Required technical and professional expertise** * 3+ years of experience as SRE Data Engineer * 3+ years of experience in scripting and automation using Python * AWS experience, RDS, RedShift and EMR will be an advantage * Experience in configuration management and CICD systems like Jenkins and Terraform * Experience working in production environments **Preferred technical and professional experience** * Excellent communication skills include effectively communicating with technical and non-technical employees and vendors * Strong problem-solving, testing, and network troubleshooting skills * A bachelor’s degree in computer science, Information Technology, or a related field will be a plus
Confirm your E-mail: Send Email
All Jobs from IBM