Lead Data Engineer (Python/Scala, Spark, AWS)

Capital One is seeking a Lead Data Engineer to join their Card Data Organization & Data Foundations group. This role focuses on building foundational capabilities for data production and consumption, including AI Assist Tools and batch workload migration. You'll work with technologies like Scala, Python, Spark, EMR, Glue, Airflow, and more to tackle problems of massive scale and critical data importance.

As a Lead Data Engineer, you'll be at the forefront of driving major transformation within Capital One, working on batch pipelines and implementing best practices in Big Data Analytics and Machine Learning. The role involves collaborating with cross-functional teams, designing and implementing technical solutions, and ensuring superior analyst experience with our tools.

The position offers competitive compensation ranging from $175,800 to $240,800 depending on location, plus performance-based incentives and comprehensive benefits. You'll be part of a team that values innovation, mentorship, and staying current with technology trends. This is an excellent opportunity for an experienced engineer looking to make an impact in financial technology while working with cutting-edge data technologies.

The ideal candidate will have strong experience in application development, big data technologies, and cloud computing, with preferred qualifications including extensive work with distributed computing tools, real-time data applications, and various database technologies. You'll be joining a company known for its commitment to technology innovation and digital transformation in the financial services sector.