Description The Artificial General Intelligence (AGI) team is looking for a highly-skilled Senior Software Engineer III to lead the development and implementation of cutting-edge technologies to push the boundaries of efficient inference for Generative Artificial Intelligence (GenAI) models. Key job responsibilities * Design, develop, test and deploy inference solutions for state-of-the-art LLMs * Create solutions that facilitate the usage and building of artificial intelligence workflows and optimize them for cost and latency. * Design and build innovative technologies in a large distributed computing environment and help lead fundamental changes in the industry. * Build solutions on top of AWS that are easy to use for customers, scalable, fault-tolerant and great to manage. * Collaborate with other engineers to identify and solve well-defined problems in GenAI * Mentor and guide junior engineers, and contribute to the overall growth and development of the team * Perform on-call duty to ensure an exceptionally frictionless experience for customers. * Work in an agile environment to deliver high quality software. A day in the life Software Dev engineers in our team are autonomous contributors to their team software. They deliver high quality features spanning the full software lifecycle including working backwards from customers, design, implementation, testing, operations and documentation. They solve well-defined business problems, sometimes through creating software solutions, and sometimes just through finding and reusing something that exists. They are coaching others on following best programming practices, as well as lead operational efforts. They partner with seniors to focus on right things and make good decisions. About the team Our team provides generative AI solutions that are the backend for novel products which are pioneering the next generation of AI applications. We are an open-minded team that looks for growing and improving not only the services we are managing, but also themselves. We are determined in our mission to innovate on behalf of our customers and are looking for talented engineers that want to go this path together with us. On some days this means we are collectively going the extra mile to get a solution out today, on other days we sit together, celebrate (and also joke) about the things we have build and achieved so far. Basic Qualifications * 5+ years of non-internship professional software development experience * 5+ years of experience programming with at least one modern language such as Java, C++, or C# including object-oriented design * 3+ years of experience contributing to the architecture and design (architecture, design patterns, reliability and scaling) of new and current systems. * Strong Computer Science fundamentals in object-oriented design, data structures, algorithm design, problem solving, and complexity analysis * Fundamental knowledge of Machine Learning algorithms and techniques Preferred Qualifications * Master’s degree in Computer Science or related field, or equivalent experience * 4+ years of experience developing complex software and delivering successfully to customers. * Experience of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience * Work experience with developing workflows that run or train machine learning models * Strong problem-solving skills, with the ability to think creatively and critically about complex problems * Strong communication and collaboration skills, with the ability to work effectively within a team Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central to our success. We make recruiting decisions based on your experience and skills. We value your passion to discover, invent, simplify and build. Protecting your privacy and the security of your data is a longstanding top priority for Amazon. Please consult our Privacy Notice (https://www.amazon.jobs/en/privacy\_page) to know more about how we collect, use and transfer the personal data of our candidates.