Massachusetts, USA
2 days ago
Lead Data Engineer
**Overview** SOSi is seeking a highly qualified **Lead Data Engineer** who is responsible for managing and optimizing data architecture, ensuring data quality, and developing processes for effective data utilization. This position will be located at Hanscom AFB, Massachusetts. **Essential Job Duties** + Design, develop, and maintain scalable data pipelines to support data integration, processing, and analysis. + Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs. + Optimize and improve existing data workflows to enhance performance and reliability. + Ensure data quality and integrity by implementing robust data validation and cleansing processes. + Develop and maintain documentation for data processes, systems, and standards. + Monitor and troubleshoot data pipeline issues to ensure smooth and timely data delivery. + Stay up to date with the latest industry trends and technologies to continuously improve data engineering practices. **Minimum Requirements** + Active TS/SCI security clearance. + Bachelor’s degree in computer science, mathematics, or equivalent technical degree, with concentrations/focus in security or equivalent, or a minimum of 6 years of enterprise data and information management experience. + 2+ years’ experience with container technologies such as Docker or Kubernetes desired. + 4+ years’ experience working with real-time and batched scalable enterprise data architecture processes and Enterprise Information Management technologies. + Technical experience to include advanced knowledge and hands-on experience supporting Enterprise Information Management services (e.g. metadata management, data tagging, data cataloging, etc.), data pipeline services based on mission needs and objectives, e.g., security info infrastructure, platforms, and software. **Preferred Qualifications** + Data engineering experience with data technologies such as Spark and integration with enterprise access control services are desired. + DOD 8570 IAT Level 2 such as Security+ or equivalent. **Work Environment** + Working conditions are normal for an office environment. + Fast paced, deadline-oriented environment. **Working at SOSi** All interested individuals will receive consideration and will not be discriminated against for any reason.
Confirm your E-mail: Send Email