Massachusetts, USA
1 day ago
Lead Data Engineer
Overview SOSi is seeking a highly qualified Lead Data Engineer who is responsible for managing and optimizing data architecture, ensuring data quality, and developing processes for effective data utilization. This position will be located at Hanscom AFB, Massachusetts. Essential Job Duties Design, develop, and maintain scalable data pipelines to support data integration, processing, and analysis. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs. Optimize and improve existing data workflows to enhance performance and reliability. Ensure data quality and integrity by implementing robust data validation and cleansing processes. Develop and maintain documentation for data processes, systems, and standards. Monitor and troubleshoot data pipeline issues to ensure smooth and timely data delivery. Stay up to date with the latest industry trends and technologies to continuously improve data engineering practices. Minimum Requirements Active TS/SCI security clearance. Bachelor’s degree in computer science, mathematics, or equivalent technical degree, with concentrations/focus in security or equivalent, or a minimum of 6 years of enterprise data and information management experience. 2+ years’ experience with container technologies such as Docker or Kubernetes desired. 4+ years’ experience working with real-time and batched scalable enterprise data architecture processes and Enterprise Information Management technologies. Technical experience to include advanced knowledge and hands-on experience supporting Enterprise Information Management services (e.g. metadata management, data tagging, data cataloging, etc.), data pipeline services based on mission needs and objectives, e.g., security info infrastructure, platforms, and software. Preferred Qualifications Data engineering experience with data technologies such as Spark and integration with enterprise access control services are desired. DOD 8570 IAT Level 2 such as Security+ or equivalent. Work Environment Working conditions are normal for an office environment. Fast paced, deadline-oriented environment. Commitment to Diversity SOSi does not discriminate against job applicants or employees on any legally recognized basis including, but not limited to age, race, color, religion, national origin, genetic information, sex, sexual orientation, gender identity or expression, marital status, disability, veteran status, or any other characteristic protected by applicable U.S. federal, state, and local laws.
Confirm your E-mail: Send Email