Staff Software Engineer - ML Observability
The ML Observability team builds cutting-edge tools to monitor, explain, and improve AI systems in production, particularly those leveraging Large Language Models (LLMs) and generative AI. We provide robust, scalable observability for AI workloads, including drift detection and model evaluation, and behavior tracing, e
What this role actually needs.
Staff Software Engineer - ML Observability at Datadog in Boston. UpJobz keeps this listing high-signal for applicants targeting serious high-tech roles across the United States, Canada, and Mexico. The ML Observability team builds cutting-edge tools to monitor, explain, and improve AI systems in production, particularly those leveraging Large Language Models (LLMs) and generative AI. We provide robust, scalable observability for AI workloads, including drift detection and model evaluation, and behavior tracing, e
Day-to-day expectations
A clear list of the work this role is designed to cover.
- Drive design and implementation of LLM observability features.
- Ideate, prototype, and scale new product features to provide insights and drive improvements for generative AI systems
- Work cross-functionally with other eng teams, product, UX, and applied science to iterate fast and find product-market fit
- Develop and extend tools for tracing, evaluating, and debugging LLMs
- Influence architecture decisions and mentor engineers to build resilient, high-performance systems
- Stay close to customer pain points and use those insights to guide product and engineering priorities
What a strong candidate brings
This keeps the job page specific, readable, and easier to match.
- Get to build tools for software engineers, just like yourself. And use the tools we build to accelerate our development.
- Have a lot of influence on product direction and impact on the business .
- Work with skilled, knowledgeable, and kind teammates who are happy to teach and learn
- Competitive global benefits
- Continuous professional development
Why people would want this job
Benefits help searchers understand whether the role is a real fit before they apply.
- Get to build tools for software engineers, just like yourself. And use the tools we build to accelerate our development.
- Have a lot of influence on product direction and impact on the business .
- Work with skilled, knowledgeable, and kind teammates who are happy to teach and learn
- Competitive global benefits
- Continuous professional development
Browse similar jobs
Turn this listing into an application plan.
This is the first pass at the premium UpJobz layer: a fast brief that helps serious applicants move with more clarity.
Next moves
- Tailor your resume around ai and llm instead of sending a generic application.
- Use the first two bullets of your application to connect your background directly to staff software engineer - ml observability is a high-signal on-site role in boston, and it is most realistic for united states residents.
- Open the role quickly if it fits and bookmark three similar jobs before you leave the page.
Interview themes
Watchouts
- Compensation is hidden, so get range clarity in the first recruiter conversation.
- Use united states residents as part of your positioning so the recruiter does not have to infer it.
- Show concrete examples of succeeding in on-site environments.
Search intent signals for this listing
Helpful keyword hooks for serious tech searchers and future programmatic job pages.
Ready to move on this role?
This page keeps the application flow simple while giving you enough context to decide quickly and move.