Taro Logo

Senior Data Engineer

Microsoft is a global technology company that empowers every person and organization on the planet to achieve more.
$119,800 - $234,700
Data
Senior Software Engineer
Hybrid
5,000+ Employees
3+ years of experience
Cybersecurity · Enterprise SaaS

Job Description

Microsoft Security aspires to make the world a safer place for all by reshaping security and empowering users, customers, and developers with end-to-end simplified solutions. As a Senior Data Engineer in the Microsoft Identity security team, you'll be crucial in protecting users from account compromise and fraud.

You'll work closely with data scientists and machine learning engineers to implement next-gen cloud-based ML and data infrastructure. Your responsibilities include creating, maintaining, and optimizing large data sets and pipelines used by the Data Science team. You'll also partner with data scientists to define business metrics and build dashboards for protection systems monitoring.

The role requires expertise in:

  • Developing tools and data pipelines processing large volume data using Apache Spark and Python
  • Data governance, compliance, and security
  • Modern data storage and processing technologies including relational/NoSQL databases
  • Experience with GDPR compliance and security
  • Expertise in data observability and pipeline optimization

You'll be part of a culture centered on embracing growth mindset and excellence, working with smart, talented, and mission-driven people to protect millions of Microsoft customers from malicious actors.

The position offers competitive compensation ($119,800 - $234,700 base salary range, higher for SF and NYC areas) and comprehensive benefits including healthcare, educational resources, savings plans, and parental leave.

This is an opportunity to apply technical skills in big data to make a real impact on security while working with cutting-edge technologies in a collaborative, mission-driven environment.

Last updated 9 hours ago

Responsibilities For Senior Data Engineer

  • Design, build, and maintain scalable, reliable, and observable data and ML infrastructure
  • Collaborate with data scientists, data source owners, and partner engineering teams
  • Create data observability to ensure data health
  • Optimize performance of big data jobs
  • Participate in technical design and code reviews
  • Proactively identify and resolve bottlenecks in data pipelines
  • Maintain compliance with all applicable laws and policies

Requirements For Senior Data Engineer

Python
  • Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ years experience OR Bachelor's Degree with 4+ years experience
  • 3+ years of experience in developing tools and data pipelines processing very large volume data using Apache Spark and Python
  • 3+ years of experience with data governance, data compliance and/or data security
  • Experience with GDPR and security compliances
  • Familiarity Azure DevOps, CICD pipeline and release automation
  • Extensive expertise in data observability

Benefits For Senior Data Engineer

Medical Insurance
Education Budget
Parental Leave
  • Industry leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Opportunities to network and connect

Related Jobs

Cloud and AI Solution Engineer - AI Data Platform

Senior Cloud & AI Solution Engineer role at Microsoft, focusing on data platform solutions for defense industry clients. Remote-friendly position with competitive pay and benefits.

Senior Data Engineer - Fabric Data and Semantic Models

Senior Data Engineer position at Microsoft focusing on building data platforms and semantic models for marketing analytics using Azure Data stack and Microsoft Fabric Platform.

Senior Software Engineer

Senior Software Engineer role at Microsoft Security focusing on data platform development and security analytics, offering competitive compensation and comprehensive benefits.

Senior Data Platform Engineer

Senior Data Platform Engineer role at Microsoft focusing on building and maintaining data infrastructure for developer experience insights.

Sr. Business Intelligence Engineer

Senior Business Intelligence Engineer role at Amazon Kuiper focusing on data analysis, forecasting, and business insights for satellite broadband services.