Senior Software Engineer

Microsoft's Web Data Platform Team is seeking a Senior Software Engineer to help scale their global web index and build Next Gen Unified Schedulers. This role focuses on building hyper-scale distributed systems that efficiently crawl and store tens of billions of URLs daily.

The position involves working on critical infrastructure that balances discovering new web pages, maintaining index freshness, and managing crawl requests to web servers. You'll be developing distributed platforms that incorporate Machine Learning models for effective resource usage, particularly important in the era of Large Language Models (LLMs) where web-scale data is crucial for training.

As a Senior Software Engineer, you'll collaborate with stakeholders to determine requirements, drive design decisions, and implement high-performance, maintainable code. You'll serve as a Designated Responsible Individual (DRI), guiding other engineers and being responsible for system monitoring and problem resolution.

The role offers a hybrid work environment with up to 50% work from home flexibility and requires 0-25% travel. Microsoft provides comprehensive benefits including industry-leading healthcare, educational resources, savings and investments, parental leave, and generous time off.

This is an excellent opportunity for experienced engineers passionate about distributed systems, web crawling, and large-scale data processing to make a significant impact on Microsoft's web infrastructure while working with cutting-edge technologies and machine learning applications.