Taro Logo

Software Engineer II

Microsoft empowers every person and organization on the planet to achieve more through innovative technology solutions.
United States
$100,600 - $199,000
Mid-Level Software Engineer
Remote
5,000+ Employees
2+ years of experience
AI · Enterprise SaaS

Job Description

Microsoft's HPC/AI team is building the next-generation distributed AI supercomputer, pushing the boundaries of artificial intelligence through unmatched computational capabilities. We're seeking talented software engineers to develop cutting-edge networking infrastructure for large-scale AI training.

As a Software Engineer II on the HPC/AI team, you'll be at the forefront of AI and high-performance computing, working on next-generation networking infrastructure for AI training and inference in Azure Cloud. This role offers a unique opportunity to work with diverse network architectures and cutting-edge processor technologies, focusing on performance, scalability, and observability.

The position involves designing and implementing high-performance, low-latency networking solutions that power distributed AI workloads. You'll work with state-of-the-art AI systems, ensuring they achieve optimal performance through advanced networking capabilities. Key responsibilities include optimizing network infrastructure, resolving complex technical challenges, and contributing to the development of scalable systems.

We offer competitive compensation ranging from $100,600 to $199,000 (higher in SF Bay Area and NYC), comprehensive benefits, and the chance to work with leading experts in AI and distributed systems. The role supports up to 100% remote work with 0-25% travel requirements.

Join us in building the future of AI supercomputing, working on technology that will power the next generation of artificial intelligence breakthroughs. You'll be part of a team that values innovation, collaboration, and continuous learning, with access to cutting-edge technology and resources to support your professional growth.

Microsoft provides an inclusive work environment, comprehensive benefits, and opportunities for advancement. We're committed to empowering every person and organization to achieve more, and we're looking for passionate engineers who share our vision for the future of technology.

Last updated 4 days ago

Responsibilities For Software Engineer II

  • Design, develop, and optimize networking solutions for large-scale AI training infrastructure
  • Architect and implement high-performance, low-latency communication frameworks
  • Benchmark, analyze, and enhance scalability of networking systems
  • Debug and resolve complex networking issues
  • Create and optimize code for performance and maintainability
  • Act as a Designated Responsible Individual (DRI)
  • Monitor system/product/service and handle on-call responsibilities

Requirements For Software Engineer II

Linux
Python
Java
JavaScript
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience
  • 1+ years of experience building distributed software
  • Proficiency in coding languages including C, C++, C#, Java, JavaScript, or Python
  • Pass Microsoft Cloud Background Check
  • Good understanding of networking protocols and distributed systems
  • Familiarity with AI accelerators such as GPUs
  • Proficiency in Linux operating systems

Benefits For Software Engineer II

Medical Insurance
Parental Leave
Education Budget
401k
  • Industry leading healthcare
  • Educational resources
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Discounts on products and services

Related Jobs

Software Engineer

Software Engineer position at Microsoft working on Azure Storage team, building massively scalable distributed storage solutions.

Software Engineer, Network Infrastructure

Software Engineer position at Google focusing on network infrastructure development, requiring C++ expertise and distributed systems experience.

Software Engineer III, Infrastructure, Google Cloud Storage

Software Engineer III position at Google Cloud Storage team working on planet-scale object storage system supporting both external Google Cloud customers and internal Google services.

Software Engineer III, Infrastructure, YouTube

Software Engineer III position at YouTube/Google focusing on infrastructure development, requiring C++ expertise and distributed systems experience, offering competitive compensation and benefits.

Software Engineer III, Infrastructure, Spanner

Software Engineer III position at Google working on Spanner infrastructure, requiring C++ expertise and distributed systems experience.