Microsoft is seeking a Senior Software Engineer to join their Azure Managed Inference team in Hyderabad. This role is at the forefront of AI innovation, building and running the model-serving platform for Generative LLMs at massive scale. The position involves designing and building highly reliable, available platforms to support model inferencing handling billions of requests daily.
The ideal candidate will have extensive experience in software engineering, particularly in distributed systems and cloud platforms. They'll need strong skills in languages like Python, Java, or C#, and experience with cloud platforms like Azure. The role requires both technical excellence in building high-performance ML workloads and strong collaborative abilities to work with cross-functional teams.
Key responsibilities include architectural design of complex software systems, code review leadership, production service support, and solving complex technical challenges. The position offers a hybrid work environment with up to 50% work from home flexibility, comprehensive benefits including healthcare and educational resources, and the opportunity to work on cutting-edge AI technology that impacts billions of users.
This is an exceptional opportunity for a seasoned engineer passionate about AI and cloud computing to join Microsoft's industry-leading team and contribute to the democratization of AI technology. The role offers significant technical challenges, growth opportunities, and the chance to work with state-of-the-art technology in a collaborative, innovative environment.