Position Description:

We are looking for an expert data engineer to design and implement ETL processes and data management focusing on elasticsearch. This person will be responsible for collecting data from various sources, preparing and transferring them to ElasticSearch for real -time and reporting analysis.

Responsibilities:

Design and execute ETL processes for Collecting, conversion and loading data to elasticsearch.
Implementation and optimization of data Pipelanes for transferring bulky data to elasticsearch.
Design of appropriate Indexs in elasticSearch for search and quick analysis of data.
monitor Elasticsearch and Query Optimization and Data Structure.
Ensure data quality and integrity at all stages.
Manage ElasticSearch with other databases and data sources.

Conditioning conditions :

Full mastery of Elasticsearch (How to Design Index, Query and Aggregation).
Experience in Python (libraries such as Pandas and Pyspark).
Experience in tools like Apache Airflow, Logstash or Beats.
fluent in MySQL: Oracle.
fluent in nosql: Modeling and Designing Optimized Structures for Search and Analysis.
experience working with data streaming tools such as Kafka (advantage).