Taro Logo

Lead Software Engineer (Data Engineer)

Global technology company in the payments industry, powering economies and empowering people in 200+ countries.
$94,000 - $150,000
Data
Staff Software Engineer
In-Person
5,000+ Employees
8+ years of experience
Finance

Description For Lead Software Engineer (Data Engineer)

Mastercard, a global leader in payment technology, is seeking a Lead Software Engineer (Data Engineer) to join their Identity Graph & Ingestion team. This role is crucial in designing and maintaining large-scale data processing systems, primarily using the Spark framework and Scala. The position is part of the Identity Verification group, which leverages machine learning models and proprietary data sets to help customers reduce transaction risks and prevent fraud.

The role sits within the Data Platform team, focusing on organizing, transforming, and governing data used by machine learning models and Data Science teams. The successful candidate will work in a geographically diverse Scrum team, collaborating with colleagues across the US west coast and central Europe. They will be responsible for designing and implementing big data processing systems, creating technical documentation, and leading system improvements.

This is an excellent opportunity for an experienced data engineer who excels in working with data at scale and has strong knowledge of algorithms and processing complexity. The role offers the chance to work with cutting-edge technologies while contributing to Mastercard's mission of powering an inclusive, digital economy that benefits everyone, everywhere.

The ideal candidate will bring strong technical expertise in Spark, SQL, and Scala, combined with experience in Databricks and Airflow. They should have a proven track record of working with cloud platforms (preferably AWS) and a solid understanding of machine learning workflows. Leadership qualities are essential, as the role involves mentoring team members, conducting technical interviews, and driving engineering culture improvements.

At Mastercard, you'll be part of a company that powers economies and empowers people in over 200 countries and territories worldwide. The organization is committed to building a sustainable economy where everyone can prosper, making this an excellent opportunity for those who want to make a significant impact in the global payments industry.

Last updated 13 days ago

Responsibilities For Lead Software Engineer (Data Engineer)

  • Work as part of a geographically diverse Scrum team
  • Design, implement, and maintain big data processing systems using Apache Spark
  • Create design documents and supporting diagrams
  • Increase capabilities and efficiency of data processing pipeline
  • Lead Retrospectives and Root Cause Analysis
  • Identify technical gaps and provide estimates for business solutions
  • Participate in team's agile process and drive prioritization decisions
  • Develop documentation templates and enforce documentation standards
  • Conduct technical interviews
  • Mentor software engineers
  • Advance company engineering culture

Requirements For Lead Software Engineer (Data Engineer)

Scala
  • Strong background in computer science
  • Proficiency in Spark, SQL, and Scala
  • Hands-on experience with Databricks and Airflow
  • Familiarity with cloud platforms (preferably AWS)
  • Experience with REST APIs and integrating external data services
  • Exposure to machine learning and data science workflows
  • Excellent understanding of Agile methodologies
  • Strong communication skills
  • Bachelor's degree in Computer Science, Software Engineering, or related field

Jobs Related To Mastercard Lead Software Engineer (Data Engineer)