Who We Are

Boston Consulting Group partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities. BCG was the pioneer in business strategy when it was founded in 1963. Today, we help clients with total transformation-inspiring complex change, enabling organizations to grow, building competitive advantage, and driving bottom-line impact.

To succeed, organizations must blend digital and human capabilities. Our diverse, global teams bring deep industry and functional expertise and a range of perspectives to spark change. BCG delivers solutions through leading-edge management consulting along with technology and design, corporate and digital ventures—and business purpose. We work in a uniquely collaborative model across the firm and throughout all levels of the client organization, generating results that allow our clients to thrive.

What You'll Do

BCG Legal has been on a Generative AI journey to transform internal operations powered through cutting edge Generative AI technologies are core to this journey. Thus, we are looking for Generative AI engineers who are passionate about designing, developing, deploying and optimizing Gen AI products at scale.

 

This role will be hosted in Legal digital products team to support building key prioritized Generative AI solutions for achieving Legal operations AI/Gen AI vision.

 

KEY RESPONSIBILITIES

 

You will work as a squad member with strong hands-on Gen AI expertise and will guide the product owners, digital leaders in conceptualizing new Gen AI products or embedding Gen AI as part of existing products in the most optimum manner. You will be an individual contributor (IC) to develop the Gen AI products along with broader squad members as well as guiding other Gen AI/LLM engineers or data scientists developing Gen AI applications.

 

Along with core Generative AI expertise, you will bring expertise in full backend development in technologies like python, typescript including REST, GraphQL etc. APIs development, core functional logic, performance, and stability of custom-built products.

 

Among your responsibilities, you will:

Conceptualize Generative AI custom products at BCG internally & operate as a technical thought partner for digital leaders and product owners.Combine data science & engineering expertise in building Generative AI productsDevelop Gen AI products as individual contributors (IC) to develop scalable high performance enterprise products along with broader squadShare expertise and recommendations on alternate approaches & tools to improve productCollaborate closely with data engineers, data scientists, software engineers, QA, product owners and analysts develop seamless end to end integrated productsBuild strong relationships with business stakeholders, ensuring alignment on project goals and successful integration of products into business processesOversee & mentor other LLM/AI engineers, data scientists in the project on Gen AI expertiseShare Gen AI knowledge & expertise across with broader digital teams squads, chapters, CoEsRegularly ramp up on latest LLMs, technologies, frameworks & platforms in the Gen AI space

What You'll Bring

Overall 9+ years of experience in engineering, machine learning & LLMs6+ years of hands-on experience in building & deploying AI/ML/Gen AI solutions in large business critical applications2+ years of experience in developing Gen AI products using variety of LLMs & frameworksAdvanced proficiency in Python for data science, engineering & LLMsHighly curious technically to evaluate & test new technologies in Gen AI spaceProven ability to work with large structured & unstructured datasets and deploy AI/ML/Gen AI solutions through automated pipelinesExperience with leveraging, training and fine-tuning Foundation Models including multimodal inputs and outputsStrong experience working with key LLM models APIs (e.g. OpenAI, Anthropic) and LLM Frameworks (e.g. LangChain, LlamaIndex)Proficiency in generating and working with embeddings across variety of data formats. Understanding of embedding spaces and their applications in semantic search and information retrieval.Knowledge of effective text chunking techniques for optimal processing and indexing of large documents or datasets.Expertise with RAG concepts and fundamentals (vectorDBs, semanticsearch, re-rankers etc.), Expertise in implementing RAG systems that combine knowledge basesExperience with multi-agent frameworks/systems and an understanding of multi-agent systems and their applications in complex problem-solving scenariosExperience in working with variety of data bases (SQL, no SQL), APIs & microservices developmentExperience with LLMOps tools (e.g. Langsmith) to implement guardrails, track accuracy, hallucinations, bias and other metrics in Gen AI productsExperience in constructing and querying knowledge graphs including graph-based reasoning.Experience in front end development technologies (e.g. REACT) would be good to haveExcellent communication skills, with the ability to explain complex technical concepts to various audiencesProven ability to operate with a transparent mindset, communicating openly with stakeholders at various levels of the organization

Who You'll Work With

As a pivotal member of the team, you will interact extensively with a diverse range of stakeholders from across the functions both geographically and functionally.

Boston Consulting Group is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, age, religion, sex, sexual orientation, gender identity / expression, national origin, disability, protected veteran status, or any other characteristic protected under national, provincial, or local law, where applicable, and those with criminal histories will be considered in a manner consistent with applicable state and local laws.\n
BCG is an E - Verify Employer. Click here for more information on E-Verify.