Job description

Overview Join the Microsoft Turing team and help shape the future of enterprise and consumer productivity with M365 Copilot. Join a fast-paced, high-visibility, and diverse team delivering innovative platform capabilities and solutions across Microsoft to hundreds of millions of users every month. As a Senior Data Scientist on the Microsoft Turing team , you will help transform how organizations use data by preparing and analyzing large-scale datasets, designing evaluations, running experiments, and driving evidence-based decisions with measurable business impact. You’ll work in small, multidisciplinary crews alongside engineers, product managers, applied scientists, and domain experts, owning the analytical lifecycle from data discovery and study design through measurement, insight generation, and product recommendations . Our work is powered by AI, applying data, experimentation, and evaluation across the development lifecycle while maintaining the highest standards of security, quality, and trust. The Microsoft Turing team is an innovative applied research and engineering organization advancing large language models and pioneering conversational search experiences. We build core platform capabilities behind Microsoft 365 Copilot, bringing AI-powered experiences into production at enterprise scale and transforming how organizations work every day. We spearhead platform innovation for multiple core Copilot experiences across Microsoft’s ecosystem . We are a fast-growing team with a broad and evolving set of opportunities. Project assignments are shaped by your interests, experience, and strengths, allowing you to grow while working on problems that matter to you. Recent launches, such as the Analyst agent in Microsoft 365 Copilot, demonstrate the importance of rigorous measurement and evaluation across the AI stack. The Microsoft Turing team combines engineering and research excellence to advance large-scale AI systems. In this environment, Data Scientists define measurement strategies, build evaluation datasets, design experiments, and translate results into product recommendations, while partnering with software engineers and applied scientists who develop and productionize the underlying systems and models. Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees, we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. Responsibilities Data Analysis & Evaluation Dataset Development • Write efficient, readable code in Python, SQL, KQL, or similar languages to prepare and analyze large-scale datasets, including customer feedback, text, and consented multimodal logs. • Build representative evaluation datasets across enterprise and consumer scenarios, including information retrieval, text creation and editing, image and file workflows, shopping, education, coding, technical support, health, sports, news, and finance. • Design evaluation coverage for text and voice inputs, single- and multi-turn conversations, and location- or geography-sensitive prompts. Cross-Functional Collaboration • Partner with engineering, product management, and applied science teams to define measurement strategies and inform product decisions. • Share findings, limitations, and recommendations that improve Microsoft 365 Copilot experiences. Experimentation & A/B Testing • Own experiment design and impact measurement for optimization hypotheses, including success metrics, guardrails, and interpretation of results. • Contribute to response-quality side-by-side evaluations by designing studies and rubrics, analyzing results, and assessing statistical and practical significance. • Compare LLM-based and human evaluations, validate alignment, investigate false positives and branding bias, and refine studies accordingly. Insights & Decision Influence • Develop decision-relevant metrics, dashboards, and compelling narratives that translate analyses into actionable product recommendations. • Present findings and analytical limitations to technical and executive audiences, build stakeholder support, and guide decisions on key product initiatives. Thought Leadership • Stay current with AI offerings and competitive developments, using data and evaluation results to identify feature gaps and opportunities. • Provide mentorship through analytical code reviews, study-design guidance, innovation, and sharing data science best practices. • Embody our  culture  and  values . Qualifications Required Qualifications: • Doctorate in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 1+ year(s) data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results) • • OR Master's Degree in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 3+ years data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results) • • OR Bachelor's Degree in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 5+ years data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results) • • OR equivalent experience. Other Requirements: Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter. Preferred Qualifications: • Doctorate in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 3+ years data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results) • • OR Master's Degree in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 6+ years data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results) • OR Bachelor's Degree in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 8+ years data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results) • OR equivalent experience. • 4+ years of experience using Python, SQL, KQL, R, or similar languages to analyze large-scale structured and unstructured datasets. • Experience driving effective cross-organizational communication, end-to-end analytical problem solving, collaboration, customer focus, and the ability to navigate ambiguity. • Demonstrated ability to communicate technical details clearly across organizational boundaries.    • Demonstrated ability to work end to end in complex analytical problem domains, from problem definition and study design through execution, interpretation, and communication of results. • One Microsoft and Values: Self-driven and results-oriented, with high integrity and a demonstrated ability to collaborate across disciplines, solve complex problems with diverse groups, and develop mutually beneficial solutions. • Customer Obsession: Customer- and metrics-driven approach to evaluation, experimentation, and product decision-making. • Growth Mindset: Demonstrated ability and motivation to learn, enter new domains, and manage through ambiguity.   #CACore #CAP Data Science IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year. Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: careers.microsoft.com This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled. Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Requirements

Must-haves

Join the Microsoft Turing team and help shape the future of enterprise and consumer productivity with M365 Copilot.
We are a fast-growing team with a broad and evolving set of opportunities. Project assignments are shaped by your interests, experience, and strengths, allowing you to grow while working on problems that matter to you.
Data Analysis & Evaluation Dataset Development
Write efficient, readable code in Python, SQL, KQL, or similar languages to prepare and analyze large-scale datasets, including customer feedback, text, and consented multimodal logs.
Design evaluation coverage for text and voice inputs, single- and multi-turn conversations, and location- or geography-sensitive prompts.
Cross-Functional Collaboration
Partner with engineering, product management, and applied science teams to define measurement strategies and inform product decisions.
Share findings, limitations, and recommendations that improve Microsoft 365 Copilot experiences.
Experimentation & A/B Testing
Own experiment design and impact measurement for optimization hypotheses, including success metrics, guardrails, and interpretation of results.
Contribute to response-quality side-by-side evaluations by designing studies and rubrics, analyzing results, and assessing statistical and practical significance.
Compare LLM-based and human evaluations, validate alignment, investigate false positives and branding bias, and refine studies accordingly.
Insights & Decision Influence
Develop decision-relevant metrics, dashboards, and compelling narratives that translate analyses into actionable product recommendations.
Present findings and analytical limitations to technical and executive audiences, build stakeholder support, and guide decisions on key product initiatives.
Thought Leadership

Nice-to-haves

OR equivalent experience.
Experience driving effective cross-organizational communication, end-to-end analytical problem solving, collaboration, customer focus, and the ability to navigate ambiguity.
Demonstrated ability to communicate technical details clearly across organizational boundaries.
Demonstrated ability to work end to end in complex analytical problem domains, from problem definition and study design through execution, interpretation, and communication of results.
Customer Obsession: Customer- and metrics-driven approach to evaluation, experimentation, and product decision-making.
Growth Mindset: Demonstrated ability and motivation to learn, enter new domains, and manage through ambiguity.
#CACore #CAP
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:

Application prep

Use the role’s language and application details while tailoring your materials.

Keywords to mirror

aipythonsqlllm

Platform: eightfold
Effort: medium