Taro Logo

Lead Software Engineer (Data Engineer)

Global technology company in the payments industry, powering economies and empowering people in 200+ countries.
$127,000 - $203,000
Data
Staff Software Engineer
In-Person
5,000+ Employees
8+ years of experience
Finance · Enterprise SaaS

Description For Lead Software Engineer (Data Engineer)

Mastercard's Identity Verification group is seeking a Lead Software Engineer (Data Engineer) to join their Data Platform team in Vancouver. This role is crucial in organizing, transforming, and governing data used by machine learning models and Data Science teams. The position involves working with large proprietary data sets and high-volume/low-latency services to help reduce transaction, account takeover, and financial risks.

The ideal candidate will be part of a geographically diverse Scrum team, working primarily with the Spark framework using Scala. You'll be responsible for designing and maintaining large data processing systems, creating technical documentation, and leading system improvements. The role requires strong technical expertise in data engineering, system design, and big data technologies, combined with leadership capabilities in mentoring team members and driving engineering culture.

This is an excellent opportunity for an experienced data engineer who wants to work at scale, handling terabytes of data while contributing to Mastercard's mission of powering an inclusive, digital economy. The position offers competitive compensation ranging from 127,000 to 203,000 CAD and the chance to work with cutting-edge technologies in a global financial technology leader.

The role combines technical excellence with leadership responsibilities, requiring both hands-on coding skills and the ability to guide team members and influence stakeholders across product, engineering, and acquisition teams. You'll be working with modern data technologies including Spark, Databricks, and cloud platforms, while helping shape the future of data processing systems at Mastercard.

Last updated 21 days ago

Responsibilities For Lead Software Engineer (Data Engineer)

  • Design, implement, and maintain big data processing systems using Apache Spark
  • Create design documents and supporting diagrams
  • Increase capabilities and efficiency of data processing pipeline
  • Lead Retrospectives and Root Cause Analysis
  • Identify technical gaps and provide estimates for business solutions
  • Participate in team's agile process and drive prioritization decisions
  • Develop documentation templates and enforce documentation standards
  • Conduct technical interviews
  • Mentor software engineers
  • Advance company engineering culture

Requirements For Lead Software Engineer (Data Engineer)

Scala
Java
  • Bachelor's degree in Computer Science, Software Engineering, or related field
  • Strong background in computer science, data structures, algorithms
  • Proficiency in Spark, SQL, and Scala
  • Hands-on experience with Databricks
  • Proficiency in Redis, ElasticCache, ElasticSearch
  • Proficiency in Java or similar OOP language
  • Working knowledge of Unix/Linux environments
  • Experience with cloud platforms (preferably AWS)
  • Experience with REST APIs and external data services
  • Experience working with large data sets
  • Excellent debugging and troubleshooting skills
  • Strong communication skills

Jobs Related To Mastercard Lead Software Engineer (Data Engineer)