Staff Applied Scientist - Dashboards

Staff Applied Scientist - Dashboards AI

About the Dashboards Product:

Datadog's Dashboards product offers a unified, single-pane-of-glass view for metrics, logs, and traces, transforming into an AI-native control surface. It serves as the central hub for teams to move seamlessly from question to insight to action, providing a guided experience akin to having an expert SRE available. Our goal is to ensure the entry point is intuitive and never an empty canvas.

About the Role:

We are hiring a Staff Applied Scientist to define and guarantee the quality of our AI system at scale. This role involves tackling complex challenges in evaluating AI systems, including answer quality, tool-selection accuracy, retrieval relevance, latency, token cost, and end-to-end agent success. You will be instrumental in answering open questions about evaluating non-deterministic agent trajectories, scoring tool selection against a growing catalog of data sources and visualizations, and building a robust measurement system that catches regressions across all widget types and data sources.

What You’ll Do:

• Own the evaluation strategy for the Dashboards product and sister teams, defining key metrics (offline/online, quality/cost, single/multi-turn).
• Build evaluation datasets, golden traces, and regression harnesses to proactively identify quality changes.
• Drive measurable improvements in retrieval relevance, tool-selection accuracy, and context efficiency in partnership with engineering teams.
• Provide technical leadership through design reviews, working groups, and mentorship.

Who You Are:

• BS/MS/PhD in a scientific field, or equivalent experience.
• 10+ years of relevant engineering or applied science experience, including technical leadership roles.
• Proven track record of leading ML or GenAI initiatives from research to production.
• Significant experience with evaluation, experimentation, or measurement of ML systems at scale.
• Strong product mindset and ability to drive cross-functional initiatives.
• Ability to thrive in ambiguity and make sound technical decisions.

Datadog Values:

Datadog values diverse perspectives and encourages applications from candidates who are passionate about technology and eager to grow their skills, even if they don't meet every qualification on day one.

Benefits and Growth:

• New hire stock equity (RSUs) and employee stock purchase plan (ESPP).
• Continuous professional development, product training, and career pathing.
• Inclusive company culture, employee resource groups (Community Guilds).
• Competitive global benefits and global Spring Health benefits for employees and dependents (age 6+).

Compensation:

• Reasonably Estimated Yearly Salary Range: $276,000—$345,000 USD
• Actual compensation will be based on skills, qualifications, and experience.
• Comprehensive benefits package including healthcare, dental, parental planning, mental health benefits, 401(k) with match, paid time off, fitness reimbursements, and discounted ESPP.

About Datadog:

Datadog is the leading observability and security platform for the AI era, providing unified visibility across the technology stack to manage complexity at scale. We integrate applications, infrastructure, data, models, and security, using AI to proactively detect and resolve issues. Trusted by Fortune 500 companies and AI leaders globally, Datadog empowers businesses to move faster with clarity and confidence.

Equal Opportunity:

Datadog is an equal opportunity employer committed to diversity and inclusion. We consider qualified applicants regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and other protected characteristics. We also consider qualified applicants with criminal histories, consistent with legal requirements.