Principal Data Scientist

Principal Data Scientist

Overview


Responsibilities

Strategic Decision Science & Measurement Leadership

• Define measurement frameworks used to evaluate strategic investments, prioritize opportunities, and assess product and business outcomes.
• Partner with Senior Directors and senior leaders to frame complex business questions and translate ambiguity into actionable decisions.
• Define success metrics, KPIs, and accountability mechanisms for critical initiatives.
• Influence product and business strategy through data-driven insights, analytical frameworks, and evidence-based recommendations.

Experimentation, Analytics & Impact Assessment

• Lead large-scale experimentation, causal inference studies, forecasting efforts, and impact assessments.
• Develop scalable measurement systems and evaluation frameworks for products, features, and strategic initiatives.
• Establish best practices for experimentation, statistical rigor, metric development, and decision quality.
• Quantify the impact of investments and provide recommendations on future direction.

AI Evaluation & Responsible Innovation

• Define evaluation frameworks and success metrics for AI-powered product experiences.
• Design and operationalize offline and online evaluation methodologies to assess quality, reliability, usefulness, and customer value.
• Partner with Product and Engineering teams to establish launch criteria, guardrail metrics, monitoring frameworks, and evidence-based decision processes.
• Drive Responsible AI practices, ensuring fairness, reliability, transparency, privacy, and measurement integrity.

Technical Leadership & Influence

• Develop reusable methodologies, analytical frameworks, and best practices that raise the quality bar across the organization.
• Communicate insights, risks, trade-offs, and recommendations to senior leadership.
• Mentor and guide data scientists through technical reviews, coaching, and thought leadership.
• Champion modern AI-assisted analytical workflows while maintaining solid scientific rigor and validation standards.

Qualifications

• Bachelor's Degree in Statistics, Data Science, Computer Science, Economics, Mathematics, Engineering, Operations Research, or a related field.
• 12+ years of experience in Data Science, Analytics, Applied Statistics, Economics, or related quantitative disciplines.
• Deep expertise in experimentation, A/B testing, statistical inference, causal analysis, forecasting, and metric design.
• Proven experience influencing high-impact product and business decisions through data and analytical insights.
• Experience designing measurement frameworks and success metrics for product, customer, and business outcomes.
• Solid programming skills in Python, SQL, R, or similar analytical languages.
• Excellent communication, collaboration, and stakeholder management skills.
• Experience supporting large-scale consumer products and services.
• Expertise in product analytics, customer measurement, engagement analysis, growth, retention, or monetization.
• Familiarity with Generative AI, Large Language Models (LLMs), and modern AI evaluation methodologies.
• Experience evaluating AI-powered experiences such as copilots, recommendation systems, search, or intelligent customer-facing products.
• Knowledge of Responsible AI principles and AI quality measurement frameworks.
• Experience with large-scale data platforms such as Spark, Cosmos, Hadoop, or cloud analytics environments.
• Join us in shaping the future of Windows through world-class decision science, experimentation, measurement, and AI evaluation.

 

 

#W+DJOBS

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Experience Level

Senior Level