Taro Logo

Senior Software Engineer - MAIA - AI Accelerator Observability and Infrastructure

Microsoft is a global technology company that develops, manufactures, and sells computer software, consumer electronics, and personal computers.
$119,800 - $234,700
Backend
Senior Software Engineer
In-Person
5,000+ Employees
4+ years of experience
AI

Job Description

The MAIA System Infrastructure team at Microsoft is seeking a Senior Software Engineer to work on AI Accelerator Observability and Infrastructure. This role is at the forefront of developing next-generation developer ecosystem for AI accelerators, focusing on building core infrastructure that enables deep observability into proprietary MAIA chips.

The position involves working at the intersection of advanced AI hardware, system software, and developer tooling. You'll be responsible for creating transparent, performant, and developer-centric ecosystem that surpasses traditional GPU observability. The role requires expertise in low-level operations, performance characteristics, and system-wide behavior analysis.

Key responsibilities include optimizing end-to-end data flow infrastructure, including PCIe and frontend networks, to ensure low-latency, high-throughput movement between host systems and accelerators. You'll work closely with hardware architects, systems engineers, and AI researchers to build a cohesive observability and runtime foundation.

The ideal candidate should have strong experience in system-level programming, data movement optimization, and Linux kernel development. Knowledge of eBPF, profiling tools, and GPU ecosystems is highly valued. The role offers competitive compensation ranging from $119,800 to $234,700 per year (higher in SF and NYC areas), along with comprehensive benefits including healthcare, educational resources, and parental leave.

This is an opportunity to make significant impact on cutting-edge AI systems, working with talented engineers who are passionate about building next-generation AI tooling infrastructure. The role requires both technical expertise and leadership skills, as you'll be expected to mentor team members and contribute to an inclusive culture.

Microsoft offers a collaborative environment with opportunities for professional growth, comprehensive benefits, and the chance to work on innovative technology that shapes the future of AI hardware acceleration. The position requires passing Microsoft Cloud background check and involves 0-25% travel.

Join Microsoft's MAIA team to pioneer the future of AI accelerator technology, working on challenging problems at the intersection of hardware and software, while contributing to a team that values diversity, innovation, and technical excellence.

Last updated 6 hours ago

Responsibilities For Senior Software Engineer - MAIA - AI Accelerator Observability and Infrastructure

  • Design, develop, and maintain the observability infrastructure for the MAIA AI accelerators
  • Optimize the data flow infrastructure over PCIe
  • Collaborate with hardware architects and system engineers
  • Develop tools and libraries that provide a holistic view of data flow, execution, and performance
  • Engage with the AI research and developer community
  • Ensure observability and data flow infrastructure meet performance, security, and reliability standards
  • Mentor and empower teammates
  • Lead by example in creating an inclusive culture

Requirements For Senior Software Engineer - MAIA - AI Accelerator Observability and Infrastructure

Python
Linux
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience
  • 3+ years of experience in system-level programming
  • 2+ years of experience optimizing data movement and communication with extremely low-latency requirements
  • Experience with Linux Kernel internals or Kernel Driver development
  • Experience with open-source development and contributions
  • Experience developing within existing GPU ecosystems
  • Expertise in developing observability, profiling, or debugging tools for complex hardware systems
  • In-depth experience with eBPF and related tools

Benefits For Senior Software Engineer - MAIA - AI Accelerator Observability and Infrastructure

Medical Insurance
Parental Leave
Education Budget
  • Industry leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Opportunities to network and connect

Related Jobs

Senior Software Engineer - Azure Resource Builder

Senior Software Engineer role at Microsoft working on Azure Resource Builder, a data processing engine handling billions of cloud resources. Remote work available with competitive compensation.

Senior Software Engineer

Senior Software Engineer role at Microsoft's AI Frameworks team, focusing on large-scale AI optimization and development of first-party AI accelerator software stack.

Senior Software Engineer

Senior Software Engineer role at Microsoft's BIC team, working on Microsoft Dataverse platform and enterprise-scale solutions with competitive pay and benefits.

Senior Silicon Engineer

Senior Silicon Engineer role at Microsoft focusing on ASIC verification and silicon validation for datacenter solutions, offering competitive pay and hybrid work arrangement.

Senior Software Engineer

Senior Software Engineer role at Microsoft's Azure Kubernetes Service team, focusing on cloud-native infrastructure and container orchestration, offering competitive pay and remote work flexibility.