Data Engineer II

Microsoft is a global technology company that delivers cloud infrastructure and foundational technologies for over 200 online businesses including Bing, MSN, Office 365, Xbox Live, Skype, OneDrive and Microsoft Azure platform.
Data
Senior Software Engineer
Hybrid
5,000+ Employees
8+ years of experience
Enterprise SaaS · Cloud
This job posting may no longer be active. You may be interested in these related jobs instead:
Member of Technical Staff - Data Engineer

Senior Data Engineer role at Microsoft AI team building data platforms and services for Copilot, requiring 4+ years experience and expertise in cloud infrastructure and data warehousing.

Senior Software Engineer

Senior Software Engineer role at Microsoft Entra focusing on AI Copilot features and data-driven solutions, offering hybrid work and comprehensive benefits.

Senior Data Engineer

Senior Data Engineer role at Microsoft Vancouver, working on MSN content ecosystem, building data pipelines and analytics solutions with competitive pay and benefits.

Senior Software Engineer – Data & AI

Senior Software Engineer position at Microsoft focusing on AI-driven network and security intelligence solutions using cutting-edge Generative AI and ML technologies.

Senior Software Engineer

Senior Software Engineer role at Microsoft's Cairo office, focusing on data pipeline development and machine learning for the shopping cashback team.

Description For Data Engineer II

Microsoft's Cloud Supply Chain (CSCP) organization is seeking a Data Engineer II to join their Decision Sciences Engineering team. This role is crucial in delivering cloud capacity and infrastructure for Microsoft's vast network of 200+ datacenters supporting over 1 billion customers globally.

The position offers an opportunity to work at the heart of Microsoft's cloud data strategy, combining data science and engineering to deliver platforms and services on Azure Data platforms. The ideal candidate will be part of a team that values growth mindset, diversity, and leadership orientation.

As a Data Engineer II, you'll be responsible for architecting and implementing modern data solutions, working with big data technologies like Spark, Azure Data Factory, and Azure ML. You'll design and maintain data pipelines, optimize data delivery systems, and ensure high-quality implementation of scalable architecture.

The role requires extensive experience in data engineering, with 8+ years of hands-on development experience in building data lakes/warehouses and working with various big data technologies. You'll be working in a hybrid environment (up to 50% work from home) with some travel requirements (0-25%).

Microsoft offers comprehensive benefits including industry-leading healthcare, educational resources, savings and investments, parental leave, and opportunities for professional growth. The company maintains a strong commitment to diversity and inclusion, ensuring every voice is heard and appreciated.

This position is perfect for someone who combines technical expertise with a collaborative mindset, can thrive in ambiguous situations, and is passionate about delivering data solutions at scale. You'll be part of Microsoft's cloud transformation journey, working on systems that power some of the world's most widely-used technology services.

Last updated 7 days ago

Responsibilities For Data Engineer II

  • Design and implement modern data architecture patterns and concepts like Data mesh, Lambda Architecture, Delta lake
  • Design, develop, and maintain data pipelines and back-end services for real-time decisioning
  • Ensure features embody engineering best practices, efficient, scalable architecture
  • Collaborate with stakeholders on data-related issues and infrastructure needs
  • Provide mentorship and guidance to other team members
  • Optimize data delivery and redesign infrastructure for greater scalability
  • Implement process improvements and maintain high-quality implementation standards

Requirements For Data Engineer II

Python
Scala
  • Bachelor's or Master's Degree in Computer Science, Data Science, Mathematics or equivalent field
  • 8+ years of hands-on development experience designing and building data lakes/datawarehouses
  • 7+ years of experience developing Big Data applications using technologies like Kusto, Databricks, Spark, Azure Data Factory, Azure ML, Azure Synapse
  • 8+ years of hands-on coding experience in Scala, Spark SQL, pyspark
  • 8+ years of hands-on data pipelines and ETL/ELT experience
  • 5+ years of experience in building OLAP systems like Azure Analysis Services, Power BI
  • Strong understanding of Data modeling including Dimensional and relational modeling

Benefits For Data Engineer II

Medical Insurance
Parental Leave
Education Budget
  • Industry leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Opportunities to network and connect

Interested in this job?