Welcome page Returning Candidate? Log back in! Sr. Data Engineer Job Post Information* : Posted Date 24 hours ago(12/11/2024 9:51 AM) ID 2024-13194 # of Positions 1 Pay Range $133,000 - $153,000 What You Will Do Implement methods to improve data reliability and quality.Deploy programmable, easily customizable infrastructure that embraces change and automates the deployment process to reduce riskAnalyze all platform level changes, monitor application impact, and provide appropriate technical solutions to resolve all issues quickly and efficientlyActively manages and escalates risk and customer-impacting issues within the day-to-day role to managementAchieve product commitments (and influences others to do the same) by using informal leadership & highly developed communication skills and contributes to or led technology communitiesUses automation, system tools, open-source solutions, observability and 'security first' principles in daily workContribute to team agile ceremonies, leads demos and presentations, helps new engineers learn established normsInitiate high level solution design approaches, and guides team to achieve desired key software delivery capabilities using automated, coded enterprise and observabilityParticipate in internal speaking and advocacy eventsSupport research activities to adopt new technology solutions in ways of developing new capabilities
to oversee and work independently on a variety of complex initiatives end-to-end (primarily on short- to medium- term issues (6-12 months) requiring specialist knowledge and/or the integration of cross-functional processes (within your own area of expertise).Provide thought leadership and/or industry knowledge specific (but not limited to) your own area of expertise.Provide guidance and influencing multiple teams across a broad spectrum of initiatives and functional domains. Skills and Experience You Will Need

Required:

5+ years relevant experience. (HDFS/SPARK/YARN/DREMIO/KAFKA/Azure PaaS)Knowledge of at least one programming language (e.g. Java, Python, R)Knowledge of Databricks (Spark with Scala or Pyspark)Hands-on experience with ETL/ELT processes and SQL database designProven ability to design, develop and secure data pipelinesGreat numerical and analytical skills.Experience with DevOps and CI/CD pipelinesExperience in IaaS Data Platform and capability enablement.Compute via Spark, storage via HDFS, ADLS, orchestration via Airflow, Dremio, etc.Experience in streaming data ingestion and processing using KafkaExperience in PaaS offerings from Azure / GCP (ADF/Databricks, etc.)Familiarity with data catalog and metadata management tools (e.g.: Unity Catalog, Collibra)Knowledge of data modeling, data quality and governance practicesMust be able to lead complex projects and competing priorities with a high level of technical acumen and strong communication skillsFamiliar with data management Access Control (Rbac / Abac).

Education

Undergraduate Degree or Technical Certificate. Who We Are

GalaxE, now Endava, is a professional IT services firm that specializes in platform-driven solutions and the use of automation to achieve enterprise business transformation and mission-critical change for some of the largest companies in the world. Using our proprietary solution set, GxFource®, we apply machine learning techniques and predictive analytics tools as part of a broad artificial intelligence strategy that provides effective impact and data-driven business transformation. 

 

Since its founding, GalaxE has been dedicated to advancing the benefits of technology. Recently, we have joined forces with Endava, to offer our employees global exposure and enhanced opportunities. As we continue that legacy and look to the future, a focus on business enablement through agile, cost-efficient, and effective integration of people, process, and technology anchors our success. We revolutionize change in the costs of doing business that transform companies and their ability to leap beyond the competition.

 

We value people and are committed to diversity and inclusion where our employees are made to feel comfortable and are encouraged to be authentic.

 

We are always looking for passionate, entrepreneurial-minded innovators and disrupters; game-changers that take ownership of the work they produce and bring it each and every day. Working with like-minded team members you will get a chance to discover, develop, and use cutting-edge technologies to transform the way we deliver creative business solutions.

 

Sound like you? Join us and find out for yourself what it means for you, and your career, to be part of the GalaxE team. Let’s build something, together.

 

*Equal Opportunity Employer/Veterans/Disabled

** Pay is based on several factors including market location and may vary depending on actual job-related knowledge, skills, and experience.

 

Physical Requirements:

Prolonged periods of remaining stationary at a desk and working on a computerMust be able to lift to 15 lbs., as neededMust be able to work on-site (corporate/client offices), as needed (not applicable for 100% remote roles)Occasionally required to bend, kneel, crouch, and reach overhead.Hand-eye coordination necessary to operate computers and various pieces of office equipment. Specific vision abilities required include close vision, the ability to tolerate fluorescent lighting, and the ability to adjust focus.

Employees must be able to perform the physical requirements of the position satisfactorily and, if requested, reasonable accommodations will be made to enable employees requiring accommodations to perform the essential functions of their jobs, absent undue hardship.

 

For more information, please visit https://info.endava.com/galaxe-has-joined-endava