Taro Logo

Principal Data Engineer

Microsoft is a technology company that empowers every person and every organization on the planet to achieve more.
$137,600 - $267,000
Data
Principal Software Engineer
Remote
5,000+ Employees
6+ years of experience
AI · Enterprise SaaS
This job posting may no longer be active. You may be interested in these related jobs instead:

Description For Principal Data Engineer

Microsoft Teams is core to Microsoft's vision for intelligent communications and productivity panes into modern workplace. As the hub for teamwork in Office 365, Microsoft Teams continue to build momentum across collaboration, chat, meetings, and calls, with over 320M monthly active users.

We are looking for a Principal Data Engineer as part of Teams data engineering team in Redmond. You will grow your skills by working on highly scalable systems and latest technologies, processing petabyte scale data daily with the latest big data tools like Microsoft Fabric, Azure Data Lake and Azure Data Explorer. You will collaborate closely with data science to derive actionable insights and influence our product and growth strategy.

As a Principal Data Engineer, you will:

  • Build advanced code to extract raw data, coach the team on techniques to validate its quality, and ensure the correct data is ingested across the pipeline.
  • Provide expertise on techniques to transform raw data into forms compatible with downstream data sources.
  • Improve data tools used to transform, manage, and access data across the organization.
  • Write code to optimize storage and availability of data platforms for increased resilience.
  • Improve performance monitoring protocols, building automation into data visualizations and aggregations to address pipeline health patterns.
  • Implement robust solutions and self-healing processes to prevent recurring points of failure across products.
  • Interpret laws and develop procedures to ensure compliance with all applicable laws and policies across the entire pipeline.
  • Govern data accessibility across multiple data pipelines and/or models.

This role offers the opportunity to work on highly scalable systems, process petabyte-scale data, and collaborate with data science teams to drive product and growth strategy. Join Microsoft to be part of a culture that values respect, integrity, and accountability, creating an inclusive environment where everyone can thrive.

Last updated 9 months ago

Responsibilities For Principal Data Engineer

  • Build advanced code to extract raw data and ensure data quality across the pipeline
  • Provide expertise on data transformation techniques
  • Improve data tools for transformation, management, and access
  • Optimize storage and availability of data platforms
  • Improve performance monitoring protocols and implement robust solutions
  • Ensure compliance with applicable laws and policies
  • Govern data accessibility across multiple data pipelines and/or models

Requirements For Principal Data Engineer

Python
Scala
Java
Rust
  • Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 6+ years experience in business analytics, data science, software development, data modeling or data engineering work OR Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years experience in business analytics, data science, software development, or data engineering work OR equivalent experience
  • 5+ years of big data experience with any of the big processing tools such as Apache Spark, Snowflake, Hadoop etc.
  • Experience in processing of Tera Bytes to Peta byte scale of data
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Pass Microsoft Cloud background check upon hire/transfer and every two years thereafter

Benefits For Principal Data Engineer

Medical Insurance
Education Budget
Parental Leave
  • Industry leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Opportunities to network and connect