Lead Data Engineer
SOS International LLC
**Overview**
SOSi is seeking a highly qualified **Lead Data Engineer** who is responsible for managing and optimizing data architecture, ensuring data quality, and developing processes for effective data utilization. This position will be located at Hanscom AFB, Massachusetts.
**Essential Job Duties**
+ Design, develop, and maintain scalable data pipelines to support data integration, processing, and analysis.
+ Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs.
+ Optimize and improve existing data workflows to enhance performance and reliability.
+ Ensure data quality and integrity by implementing robust data validation and cleansing processes.
+ Develop and maintain documentation for data processes, systems, and standards.
+ Monitor and troubleshoot data pipeline issues to ensure smooth and timely data delivery.
+ Stay up to date with the latest industry trends and technologies to continuously improve data engineering practices.
**Minimum Requirements**
+ Active TS/SCI security clearance.
+ Bachelor’s degree in computer science, mathematics, or equivalent technical degree, with concentrations/focus in security or equivalent, or a minimum of 6 years of enterprise data and information management experience.
+ 2+ years’ experience with container technologies such as Docker or Kubernetes desired.
+ 4+ years’ experience working with real-time and batched scalable enterprise data architecture processes and Enterprise Information Management technologies.
+ Technical experience to include advanced knowledge and hands-on experience supporting Enterprise Information Management services (e.g. metadata management, data tagging, data cataloging, etc.), data pipeline services based on mission needs and objectives, e.g., security info infrastructure, platforms, and software.
**Preferred Qualifications**
+ Data engineering experience with data technologies such as Spark and integration with enterprise access control services are desired.
+ DOD 8570 IAT Level 2 such as Security+ or equivalent.
**Work Environment**
+ Working conditions are normal for an office environment.
+ Fast paced, deadline-oriented environment.
**Working at SOSi**
All interested individuals will receive consideration and will not be discriminated against for any reason.
Confirm your E-mail: Send Email
All Jobs from SOS International LLC