Senior Software Engineer

Microsoft is seeking a Senior Software Engineer to join their Azure Open AI Inference team in Hyderabad. This role is at the forefront of Microsoft's AI strategy, focusing on building and running the model-serving platform for large OpenAI generative models.

The position involves designing and building highly reliable platforms to support model inferencing at massive scale - handling billions of requests per day. You'll work on high throughput/low latency scenarios and drive performance optimization capabilities. The team powers every Azure OpenAI customer scenario, including both third-party and first-party customers like Bing and Office.

As a Senior Software Engineer, you'll be responsible for architectural design of complex software systems, code reviews, problem-solving, and project leadership. The role requires participation in on-call rotations to support services and handle incidents. You'll work in a hybrid environment (3 days/week in office) with 0-25% travel requirements.

The ideal candidate should have 7+ years of software development experience and a strong background in computer science or related fields. Experience with real-time services, high throughput, and low latency requirements is highly valued. Microsoft offers comprehensive benefits including healthcare, educational resources, parental leave, and investment options.

This is an excellent opportunity to work at the intersection of AI and Cloud computing, contributing to Microsoft's mission of democratizing AI technology. The role combines technical leadership with hands-on development, making it perfect for experienced engineers passionate about building scalable AI infrastructure.