Crowdsourcing is critical for many of Microsoft’s machine learning features. The UHRS (Universal Human Relevance System) team within Microsoft is central to these efforts. We are responsible for the platform that enables data annotation using a large, diverse, worldwide set of labelers. This data is foundation to evaluate and train AI (Artificial Intelligence) and ML (Machine Learning) models across Microsoft. We are one of the largest AI labelling platforms world-wide and aspire to grow by a magnitude in coming years. Scaling of our platform should be increased by 20X, with improved analytics for judge and task owners, as well as more control for task owners, all while making everything simpler to use. Additional work will involve creating an entirely new serving architecture, task recommendation system for judges, judge reputation, various judge and task analysis, judge and task dashboards, alerting, etc. You will find engineering challenges around big data and have opportunity to work with world class data scientists. You will work across our stack, from our public-facing React-based UX, to our Azure-hosted backend, to analyzing data with the latest available tools. You will impact the latest products across Microsoft, used by billions of people.