Software Engineer II

Microsoft's Web Data Platform Team is seeking a Software Engineer II to help scale their web index and build Next Gen Unified Schedulers. This role focuses on building hyper-scale distributed systems that crawl and store tens of billions of URLs daily. The position involves working on a distributed platform that incorporates Machine Learning models for efficient resource usage, while maintaining a balance between discovering new web pages and maintaining index freshness.

The role offers an opportunity to work on critical infrastructure that supports both web crawling operations and Large Language Model (LLM) training needs. You'll be part of a team that's pushing the boundaries of web-scale data processing and storage, working with cutting-edge technologies and distributed systems.

As a Software Engineer II, you'll collaborate with stakeholders to determine requirements, develop design documents, and implement high-performance code. You'll serve as a Designated Responsible Individual (DRI), monitoring system health and guiding other engineers. The position offers competitive compensation, comprehensive benefits, and the chance to work in a hybrid environment with up to 50% work from home flexibility.

Microsoft provides an inclusive culture focused on growth mindset and innovation. The role offers extensive learning opportunities, working with advanced technologies in web crawling, distributed systems, and machine learning. Benefits include industry-leading healthcare, educational resources, investment options, parental leave, and various other perks.

This position is ideal for engineers passionate about large-scale distributed systems, with interest in web technologies and data processing. You'll have the opportunity to impact Microsoft's web data infrastructure while working with a talented team in a supportive environment that promotes work-life balance and professional growth.