Taro Logo

Software Engineer II - AI Infrastructure

Microsoft's mission is to empower every person and every organization on the planet to achieve more.
$100,600 - $199,000
Machine Learning
Mid-Level Software Engineer
Hybrid
5,000+ Employees
2+ years of experience
AI · Enterprise SaaS

Job Description

Join Microsoft's Packaging and Content (PAC) team within the Experiences + Devices (E+D) organization as a Software Engineer II focused on AI Infrastructure. This role combines software engineering expertise with AI/ML specialization, offering the opportunity to architect and design systems that scale internal tools capabilities.

The position involves working with cutting-edge AI technologies, developing infrastructure for AI platforms, and implementing secure system architectures that leverage the Microsoft stack. You'll be responsible for creating solutions that optimize workflow efficiencies and expand data insights, while ensuring robust security and compliance standards.

Key aspects of the role include:

  • Architecting AI infrastructure and platforms to accelerate team productivity
  • Developing and maintaining secure system architectures using Microsoft technologies
  • Implementing DevOps best practices and continuous integration/deployment
  • Creating AI-assisted applications and workflow automations
  • Ensuring security compliance and risk management
  • Collaborating with cross-functional teams across Microsoft

The role offers competitive compensation ($100,600 - $199,000 base salary range), comprehensive benefits, and the opportunity to work in a hybrid environment (up to 50% work from home). You'll be part of a culture that values respect, integrity, and accountability, with access to industry-leading healthcare, educational resources, and various other benefits.

This position is perfect for someone who combines strong software engineering fundamentals with expertise in AI/ML technologies and a passion for building scalable, secure infrastructure. You'll have the autonomy to be creative and innovative while working on solutions that have broad impact across Microsoft.

Last updated 2 days ago

Responsibilities For Software Engineer II - AI Infrastructure

  • Define AI Infrastructure and the future of AI Platforms to accelerate the PAC team's AI productivity
  • Create and maintain robust and secure system architecture leveraging Microsoft stack
  • Apply best practices in software engineering, including code reviews, testing, and continuous integration
  • Define and implement DevOps processes & technologies
  • Ensure security, privacy, safety, and accessibility compliance
  • Implement workflow automations and AI-assisted applications
  • Collaborate with cross-functional teams and provide technical guidance

Requirements For Software Engineer II - AI Infrastructure

Python
Java
JavaScript
TypeScript
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including C, C++, C#, Java, JavaScript, or Python
  • 1+ years experience with Microsoft Azure stack
  • 1+ years experience in hardware acceleration of AI/ML models
  • 1+ years experience in deep learning frameworks and tensor libraries like PyTorch, Tensorflow, JAX/FLAX
  • Must pass Microsoft Cloud background check

Benefits For Software Engineer II - AI Infrastructure

Medical Insurance
Parental Leave
Education Budget
  • Industry leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Opportunities to network and connect

Related Jobs

Software Engineer II

Software Engineer II position at Microsoft's Applied Sciences Group, focusing on machine learning and next-generation Windows devices development with hybrid work options.

Software Engineer - AI/ML, Multiple Locations

Software Engineer position at Microsoft focusing on AI/ML development, offering competitive salary and benefits with flexible work arrangements.

Machine Learning Engineer II

Microsoft is seeking a Machine Learning Engineer II to develop AI technologies for Copilot Studio, offering competitive pay, hybrid work, and comprehensive benefits.

Software Engineer 2

Software Engineer 2 position at Microsoft focusing on AI/ML development and agent systems within the Learning Product Team.

AI/ML QA Engineer

AI/ML QA Engineer position at Broadcom focusing on testing AI/ML Interconnect Solutions with emphasis on Ethernet, networking, and GPU technologies.