Principal Software Engineer

Microsoft is a global technology company that empowers every person and organization on the planet to achieve more.
United States
$137,600 - $267,000
Machine Learning
Principal Software Engineer
Remote
5,000+ Employees
6+ years of experience
AI · Cybersecurity · Enterprise SaaS

Description For Principal Software Engineer

Microsoft Security is seeking a Principal Software Engineer to join the Security Copilot AI Platform Team. This role focuses on defining architectural direction for Orchestrator, Agents Engine, and AI services to support LLM interactions. The position is part of Microsoft's Security organization, which aims to make the world safer through end-to-end security solutions.

The role involves leading the design and development of enterprise-based platforms, ensuring scalability and performance. You'll work with AI researchers and security engineers to enhance retrieval-augmented generation workflows and ensure responsible AI compliance. Key responsibilities include implementing best practices for model evaluation, mentoring other engineers, and collaborating with product management on roadmap initiatives.

The ideal candidate should have extensive experience in Software/AI/ML Engineering, with strong knowledge of LLMs, transformers, and AI safety. The position offers competitive compensation with a base pay range of $137,600 - $267,000 (higher in SF and NYC areas), along with comprehensive benefits including healthcare, educational resources, and parental leave.

This is an opportunity to work at the forefront of AI security innovation, combining advanced technical skills with strategic leadership to shape the future of security solutions. The role requires both deep technical expertise and the ability to drive alignment across stakeholders while maintaining Microsoft's culture of growth mindset and excellence.

Microsoft Security represents critical priorities in digital threats, regulatory scrutiny, and estate complexity. The team aims to reshape security and empower users, customers, and developers with simplified security cloud solutions. This position offers the chance to impact billions of lives while working with cutting-edge AI technology in security applications.

Last updated 8 hours ago

Responsibilities For Principal Software Engineer

  • Lead the design and development of enterprise-based platform
  • Collaborate with cross-functional teams to define technical requirements
  • Implement best practices for model evaluation and deployment
  • Mentor and guide Senior and junior engineers
  • Collaborate with product management on features and roadmap initiatives
  • Ensure adherence to coding standards and software quality
  • Create framework learning and maintenance processes
  • Develop material for Copilot for Security Platform

Requirements For Principal Software Engineer

Python
Java
JavaScript
  • Bachelor's Degree in Computer Science, or related technical discipline AND 6+ years technical engineering experience
  • 6+ years of industry experience in Software/AI/ML Engineering, NLP, or Security AI applications
  • Proficient understanding of LLMs, transformers, agents, learning and fine-tuning techniques
  • Experience in ML model selection, inference optimization, and retrieval-augmented generation (RAG)
  • Knowledge of AI safety, bias mitigation, and compliance frameworks
  • Hands-on experience with orchestration frameworks
  • Proficiency in vector databases and LLM caching mechanism

Benefits For Principal Software Engineer

Medical Insurance
Education Budget
Parental Leave
  • Industry leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Opportunities to network and connect

Interested in this job?

Jobs Related To Microsoft Principal Software Engineer

Principal Software Engineer

Principal Software Engineer role at Microsoft working on Azure Machine Learning, optimizing LLMs and Diffusion models for high-scale inference, collaborating directly with OpenAI.

Principal Software Engineer

Principal Software Engineer role at Microsoft's Core AI division, focusing on building AI platforms and developer experiences for LLM technologies.

Principal Software Engineer

Lead the development of AI software and infrastructure for Microsoft's next-generation supercomputers and AI accelerators, focusing on system software stacks and developer tools.

Principal Software Engineer

Principal Software Engineer position at Microsoft's AI Frameworks team, focusing on developing and optimizing AI software and LLM infrastructure across Microsoft's product ecosystem.

Principal Software Engineer - AI Platform

Lead the development of Microsoft's AI platform infrastructure, architecting solutions for AI model deployment from supercomputers to mobile devices, working directly with OpenAI and internal teams.