Microsoft is on a mission to empower every person and every organization on the planet to achieve more. As a Senior Data Engineer, Telemetry on the CO+I Critical Environment Service Intelligence (CESI) team, you will partner and collaborate on the design and delivery of automated solutions to monitor, detect, and alert on data center critical environment mechanical and electrical resources. You will work with massive amounts of data with low latency requirements across cutting edge technologies, with the potential for significant impact to both internal partners and external customers.
Key responsibilities include:
- Driving a program for end-to-end onboarding, monitoring, and processing of critical environment (CE) infrastructure telemetry for all leased sites.
- Designing and implementing telemetry data ingestion and data processing systems for leased sites.
- Prototyping, piloting, and deploying multi-signal anomaly detection and prevention systems leveraging machine learning and statistical analysis.
- Defining and driving an operationalization plan for the telemetry pipeline for leased sites.
- Ensuring interoperability of detection methods, systems, and workflows by defining conceptual, logical, and physical data models.
- Understanding signals from EPMS and BAS systems for leased sites.
- Ensuring high coverage and mapping of leased site signals including thermal, power, and other environmental conditions.
- Defining reusable primitives for mapping logical and physical topology of data center leased sites.
- Implementing a high-frequency, high-volume, low-latency streaming and micro-batching capable pipeline to process DC CE telemetry from leased sites.
This role offers the opportunity to work with cutting-edge technologies and make a significant impact on Microsoft's cloud infrastructure. The ideal candidate will have a strong background in data engineering, cloud computing, and a passion for working with large-scale systems.