Barbaricum is seeking a Generative AI (GenAI) Subject Matter Expert (SME) to lead technical benchmarking, model evaluation, and best practices for implementing LLMs and AI-driven solutions in the DoD. This role focuses on retrieval-augmented generation (RAG), model performance monitoring, and AI-driven document analysis using AWS Bedrock, AWS Sagemaker, and other AI frameworks.

Responsibilities:

Lead technical research and benchmarking for GenAI and RAG implementations. Develop model performance evaluation metrics to optimize AI-driven workflows. Provide expert guidance on LLM integration for DoD applications. Test, validate, and refine GenAI models, ensuring efficiency and reliability. Recommend best practices for unstructured document and content analysis using AI.

Qualifications:

Must be a U.S. Citizen and reside within the United States. AWS certifications highly preferred; AIML and SEC experience is a plus. Bachelor’s degree plus 7+ years of experience, or Master’s degree plus 5+ years of experience in AI, Machine Learning, or Data Science. Experience with LLMs, Generative AI, RAG, and AI-powered knowledge retrieval. Strong expertise in AWS Bedrock, cloud AI services, and AI model benchmarking. Proficiency in Python, SQL, and AI evaluation frameworks.