Description The Artificial General Intelligence (AGI) team is looking for a highly-skilled Senior Machine Learning Engineer III to lead the development and implementation of cutting-edge technologies to push the boundaries of efficient inference for Generative Artificial Intelligence (GenAI) models. Key job responsibilities * Design, develop, test and deploy inference solutions for high-end LLMs * Create solutions that facilitate the usage and building of artificial intelligence workflows and optimize them for cost and latency. * Design and build innovative technologies in a large distributed computing environment and help lead fundamental changes in the industry. * Build solutions on top of AWS that are easy to use for customers, scalable, fault-tolerant and great to manage. * Collaborate with cross-functional teams of engineers and scientists to identify and solve complex problems in GenAI * Mentor and guide junior engineers, and contribute to the overall growth and development of the team * Perform on-call duty to ensure an exceptionally frictionless experience for customers. A day in the life Senior engineers in our team are independent and have much freedom in the way they contribute. They stay up-to-date with new solutions, read recent papers, explore ideas, brainstorm and freely connect with others to cooperate. They detect, investigate and resolve complex problems, sometimes through creating software solutions, and sometimes just through finding and reusing something that exists. They partner with leaders to focus on right things and make good decisions. They are making sure the team follows best design and programming best practices, as well as lead operational efforts. About the team Our team provides generative AI solutions that are the backend for novel products which are pioneering the next generation of AI applications. We are an open-minded team that looks for growing and improving not only the services we are managing, but also themselves. We are determined in our mission to innovate on behalf of our customers and are looking for talented engineers that want to go this path together with us. On some days this means we are collectively going the extra mile to get a solution out today, on other days we sit together, celebrate (and also joke) about the things we have build and achieved so far. Basic Qualifications * 5+ years of non-internship, professional software development experience * 5+ years of programming with at least one modern language such as Java, C++, or C# including object-oriented design experience * Experience leading the architecture and design (architecture, design patterns, reliability and scaling) of new and current systems * Experience building complex software systems that have been successfully delivered to customers * Solid knowledge of Machine Learning algorithms and techniques * Experience as a mentor, tech lead or leading an engineering team Preferred Qualifications * Masters's degree in computer science or equivalent * 5+ years of experience of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience * Experience working with transformer architectures, inference optimization technics and Large Language Models * Excellent problem-solving skills, with the ability to think creatively and critically about complex problems * Strong communication and collaboration skills, with the ability to work effectively with cross-functional teams Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central to our success. We make recruiting decisions based on your experience and skills. We value your passion to discover, invent, simplify and build. Protecting your privacy and the security of your data is a longstanding top priority for Amazon. Please consult our Privacy Notice (https://www.amazon.jobs/en/privacy\_page) to know more about how we collect, use and transfer the personal data of our candidates. Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.