Barcelona
6 days ago
DS Data Engineer
Job Description

Posted 4 days ago

​As you contemplate your future, you might be asking yourself, what’s the next step? Start your journey with us!

​We’re looking for a Data Engineer to help us design, build and manage our data and machine learning platform.  You’ll join a team of highly skilled Data Engineers in charge of developing highly scalable Big Data platforms that allow the collection, storage, modelling and analysis of datasets in Barcelona at eDreams ODIGEO.

​Why eDreams ODIGEO

Join the world’s leading travel subscription platform and one of the largest e-commerce businesses in Europe.

22 million customers – 44 markets – 5 brands – 7M members in Prime

More than 100 million searches per day – Up to 6 billion daily AI predictions[e1]

Over 1,600 employees – More than 50 different nationalities from all continents – 99% permanent contracts – 36 average age

We’re the world’s leading travel subscription platform and one of the largest e-commerce businesses in Europe. We are a tech company revolutionising the travel booking experience through our consumer insight, innovative technology, market leadership, and Prime, the world’s first travel subscription program.

​What you will do

​The Role’s Key Responsibilities and Tasks

We work close to Data Scientists and business units to provide them with the tools to access the data they need and to put their models in production. We focus on quality, automation and incremental improvements to reduce the overall time-to-market of Data Science solutions.

If you have a solid background in Data Engineering, feel a passion for data and distributed systems, and enjoy teamwork and shared challenges, join us to optimise, automate and develop new solutions to grow our platform!

Data Architecture and Scalability:

Design and implement eDreams’ data architecture with a focus on scalability, performance, and data quality.

Ensure the architecture is sophisticated, maintainable, and adaptable to future growth.

Infrastructure Management and Automation:

Define and maintain the current data engineering environment and tools, including Jenkins, Google Kubernetes Engine (GKE), and Cloud Composer (Airflow).

Automate the development and deployment processes of ETL pipelines to empower stakeholders and increase autonomy.

Utilize Docker and Docker Compose for building and testing ETL processes.

ETL Development and Optimization:

​Develop, maintain, and optimize ETL pipelines and related tools, primarily using Python.

Contribute to Java and Scala/Spark projects as needed.

Write and execute complex SQL queries on Google BigQuery for data analysis and transformation.

  Platform Evolution and Innovation:

Drive the evolution of the GCP data platform by researching and implementing new and emerging technologies.

Contribute to the development and enhancement of internal libraries and automation tools to reduce time-to-market.

Collaboration and Communication:

Collaborate with stakeholders to align, clarify, and gather project business requirements.

Utilize Git (Bitbucket) for version control and collaborative code development.

Strong communication skills are required to explain technical concepts to stakeholders.

What you need to succeed:  

Good to have

Degree in Computer Science or equivalent (IT engineer).

At least 3 years of experience in Data Engineering.

Proficiency in Python for data engineering tasks.

Experience with Java and Scala/Spark (desirable).

Expertise in SQL and Google BigQuery.

Hands-on experience with cloud platforms, specifically Google Cloud Platform (GCP).

Experience with containerization (Docker, Docker Compose) and orchestration (Kubernetes/GKE).

Familiarity with workflow orchestration tools (Airflow/Cloud Composer).

Experience with CI/CD pipelines (Jenkins).

Strong understanding of data architecture principles.

Excellent problem-solving and analytical skills.

Good understanding of Git version control.

Ability to gather and translate business requirements.

Working English fluency.

What’s in it for you?

The best talent deserves the best benefits

At eDO, we want you to be a part of our success story and great culture.

Here’s what we offer:

A rewarding Compensation package! 
Confirm your E-mail: Send Email