Various
12 days ago
Mid-Level Data Engineer - 4547
.video-wrapper svg { top:40%; } U.S. - Finding purpose at CGI By playing this video you consent to Google/YouTube processing your data and using cookies – Learn more. Position Description:

​CGI has an immediate need for a Data Engineer (Developer III) to join our team. This is an exciting opportunity to work in a fast-paced team environment supporting one of the largest customers. We take an innovative approach to supporting our client, working side-by-side in an agile environment using emerging technologies.

• While this position must be located within a commutable distance to a CGI office, a hybrid working model is acceptable.

We partner with 15 of the top 20 banks globally, and our top 10 banking clients have worked with us for an average of 26 years!

We have over 92,000+ CGI Members in 40 countries and over 5k+ loyal Clients who are leveraging our end-to-end services across the globe.


We are seeking a Mid Level Python/PySpark Developer with AWS For a large financial service client.

Your future duties and responsibilities:

- Job consists of setting up Change Data Capture (or CDC) for multiple types of databases for the purpose of hydrating a data lake.
- Debezium or other CDC knowledge required.
- Along with data hydration, job requires knowledge on ETL transformations using Apache spark, both streaming and batch processing of data.
- Engineer needs to know how to work with Apache Spark Data Frames, ETL jobs, and streaming data pipelines that will orchestrate raw CDC data and transform it into useable and query-able data for analytics.
- Big Data concepts, including performance tuning is a plus.

Required qualifications to be successful in this role:

- 5-7+ years of IT experience with 4+ years of AWS Development and Cloud Architecture.
- 2-4+ years of experience with Python (must have)
- Apache Spark – Data Frames, Spark SQL, Spark Streaming and ETL pipelines
- Apache Airflow
- Scala – not required but a plus
- Apache Hudi – not required, but a plus
- Apache Griffin – not required, but a plus
- Extensive knowledge with S3 and S3 operations (CRUD)
- EMR & EMR Serverless
- Glue Data Catalog
- Step Functions
- MWAA (Managed Workflows Apache Airflow)
- Lambdas (Python)
- AWS Batch
- AWS Deequ – not required, but a plus

Education:
- Bachelor's degree in computer science, Information Systems or related field
- AWS Certification(s) desired

**CGI anticipates accepting applications for this position through March 31st, 2025.**

CGI is required by law in some jurisdictions to include a reasonable estimate of the compensation range for this role. The determination of this range includes various factors not limited to skill set, level, experience, relevant training, and licensure and certifications. To support the ability to reward for merit-based performance, CGI typically does not hire individuals at or near the top of the range for their role. Compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range for this role in the U.S. is $74,600.00 - $146,900.00.

CGI’s benefits are offered to eligible professionals on their first day of employment to include:

•Competitive compensation
•Comprehensive insurance options
•Matching contributions through the 401(k) plan and the share purchase plan
•Paid time off for vacation, holidays, and sick time
•Paid parental leave
•Learning opportunities and tuition assistance
•Wellness and Well-being programs

#LI-BR1

Skills: ETLOraclePostgre SQLPythonSQL What you can expect from us:

Together, as owners, let’s turn meaningful insights into action.

Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you’ll reach your full potential because…

You are invited to be an owner from day 1 as we work together to bring our Dream to life. That’s why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company’s strategy and direction.

Your work creates value. You’ll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise.

You’ll shape your career by joining a company built to grow and last. You’ll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.

Come join our team—one of the largest IT and business consulting services firms in the world.

Confirm your E-mail: Send Email