HackerRank is at the forefront of innovation in machine learning and AI. We are launching an ambitious data commercialization program where we are creating a comprehensive benchmark to assess the performance of large language models (LLMs) on software development tasks and generating new content and data specifically to improve state-of-the-art LLMs on software engineering tasks. We are seeking a highly skilled and motivated research engineer to join our team and help us drive this initiative forward. This position is Full-Time and Remote within North America. 

Key Responsibilities:

Design & develop evaluation metrics and benchmark methodologies and conduct experiments to evaluate the performance of various LLMs on software engineering tasks. Develop & deploy data pipelines for LLM training and evaluation datasets. Contribute to the development and deployment of state-of-the-art machine learning models. Collaborate with cross-functional teams to ensure the seamless integration of the benchmark into our broader data commercialization strategy. Stay abreast of the latest machine learning and LLMs advancements to ensure our benchmarks and models remain cutting-edge.

Qualifications:

Advanced degree (Master's) in Computer Science, Machine Learning, Data Science, or a related field. Proven experience in machine learning, with a strong emphasis on LLMs and natural language processing. Demonstrated experience in preparing and conducting evaluations of machine learning models. Experience developing large-scale data pipelines for research datasets. Proficiency in programming languages such as Python and familiarity with machine learning frameworks (e.g., TensorFlow, PyTorch).

Preferred Qualifications:

Experience in benchmarking and performance evaluation of LLMs & designing high-scale data pipelines Published research in relevant fields. Familiarity with coding challenges and competitive programming. Benefits & Perks:

We have a full package of competitive benefits and perks, which include the following:

One-time home office set up stipend Monthly Remote Work Enablement Stipend Professional Development Reimbursement Wellbeing Benefits (Headspace, etc) Flexible paid time off, paid leave for new parents, and flexible work hours Insurance for all employees (term life, personal accident, medical) along with medical insurance for their dependents Employee stock options About HackerRank:

HackerRank is a Y Combinator alumnus backed by tier-one Silicon Valley VCs with total funding of over $100 million. The HackerRank Developer Skills Platform is the standard for assessing developer skills for 2,500+ companies across industries and 23M+ developers worldwide. Companies like LinkedIn, Stripe, and Peloton rely on HackerRank to objectively evaluate skills against millions of developers at every hiring process, allowing teams to hire the best and reduce engineering time. Developers rely on HackerRank to turn their skills into great jobs. We’re data-driven givers who take full ownership of our work and love delighting our customers!

HackerRank is a proud equal employment opportunity and affirmative action employer. We provide equal opportunity to everyone for employment based on individual performance and qualification. We never discriminate based on race, religion, national origin, gender identity or expression, sexual orientation, age, marital, veteran, or disability status. All your information will be kept confidential according to EEO guidelines.

We offer a comprehensive total rewards package where you’ll be rewarded based on your performance and recognized for the value you bring to the business. 

Total compensation and benefits consist of salary, quarterly performance incentives, equity (stock options), medical, dental, vision, life insurance, travel insurance, monthly work-from-home stipend, learning and development reimbursements, flexible remote-first work culture, 401(K), flexible time off, generous parental leave and more. Under our flexible paid time off policy, you’ll decide how much time you need based on your circumstances.

Current base salary range: ($160,000 - $180,000). The exact salary may vary based on skills, experience, location, market ranges, and other compensation offered. The salary range does not include other compensation components, commission (for sales-related roles), bonuses, or benefits for which you may be eligible. Salary may be adjusted based on business needs.

Notice to prospective HackerRank job applicants:
We’ve noticed fake accounts posing as HackerRank Recruiters on Linkedin and through text. These imposters trick you into paying them for jobs/providing credit check information.
Here’s how to spot the real deal:

Our Recruiters use @hackerrank.com email addresses. We never ask for payment or credit check information to apply, interview, or work here. 

Thanks for your interest in HackerRank!

#LI-Remote