Staff Software Engineer - AI Platforms
Job Description
Datadog is seeking a Staff Software Engineer to join their AI Platforms team, focusing on building robust ML infrastructure and evaluation systems. This is a key technical leadership role within a rapidly growing global SaaS company that provides essential monitoring and security solutions for cloud applications.
The position involves designing and implementing scalable evaluation frameworks that power Datadog's AI platform, working with cutting-edge technologies and tools like Ray.io and custom in-house solutions. You'll be responsible for building backend systems for large-scale model experimentation and developing infrastructure for dataset versioning and test set management.
As a technical leader, you'll collaborate closely with AI researchers and product teams, guiding technical direction across multiple projects while ensuring scalability and reliability. The role requires deep expertise in ML infrastructure and evaluation, with opportunities to mentor other engineers and shape the team's technical culture.
The ideal candidate brings 10+ years of engineering experience, strong ML fundamentals, and a proven track record of building production-grade systems using modern cloud infrastructure. You'll work in a hybrid environment that values both in-person collaboration and flexibility, with competitive compensation including a salary range of $234,000 - $300,000 USD plus equity.
Datadog offers comprehensive benefits including healthcare, dental, mental health support, 401(k) matching, and professional development opportunities. This is an excellent opportunity for a senior technical leader to make a significant impact in a fast-growing company at the forefront of AI and cloud technology.
Responsibilities For Staff Software Engineer - AI Platforms
- Act as a technical leader on the AI Platforms team, focused on building robust ML infrastructure and evaluation systems
- Design and implement scalable, reproducible, and easy-to-use evaluation frameworks
- Build backend systems to power large-scale model experimentation
- Develop tooling and infrastructure to support dataset versioning, model evaluation, and test set management
- Collaborate with AI researchers and application teams
- Guide technical direction across multiple projects
- Mentor other engineers and contribute to design reviews
Requirements For Staff Software Engineer - AI Platforms
- BS/MS/PhD in Computer Science or related field, or equivalent experience
- 10+ years of relevant engineering experience
- Deep experience building ML infrastructure or ML platforms
- Strong understanding of machine learning principles
- Proven ability to drive cross-functional initiatives
- Experience building and operating production-grade systems using modern cloud infrastructure
- Product-minded, collaborative, and thrive in fast-paced environments
Benefits For Staff Software Engineer - AI Platforms
- Competitive salary and equity package
- Healthcare benefits
- Dental benefits
- Mental health benefits
- 401(k) plan and match
- Paid time off
- Fitness reimbursements
- Employee stock purchase plan
- Professional development opportunities
Related Jobs
