Lead Data Engineer (Python, Spark, AWS)

A leading financial services company that provides credit cards, banking, and lending services.
$175,800 - $200,700
Data
Staff Software Engineer
In-Person
5,000+ Employees
4+ years of experience
Finance

Description For Lead Data Engineer (Python, Spark, AWS)

Capital One is seeking a Lead Data Engineer to join their team in pioneering technology solutions. This role offers an opportunity to be at the forefront of driving major transformation within Capital One, working with emerging technologies and big data. The position involves collaborating with Agile teams to design and implement technical solutions using Python, Spark, and AWS. You'll work on complex business problems in a fast-paced, collaborative environment, utilizing various programming languages and technologies. The role requires expertise in big data technologies, cloud computing, and distributed systems. You'll be responsible for developing and maintaining data pipelines, working with machine learning systems, and mentoring other team members. Capital One offers a competitive compensation package including comprehensive benefits and performance-based incentives. This is an excellent opportunity for experienced data engineers looking to make an impact at a leading financial institution while working with cutting-edge technologies.

Last updated 2 hours ago

Responsibilities For Lead Data Engineer (Python, Spark, AWS)

  • Collaborate with Agile teams to design, develop, test, implement, and support technical solutions
  • Work with machine learning, distributed microservices, and full stack systems
  • Utilize programming languages and databases including Java, Scala, Python, RDBMS, NoSQL
  • Share technical knowledge and mentor other engineers
  • Collaborate with product managers to deliver cloud-based solutions
  • Perform unit tests and conduct code reviews

Requirements For Lead Data Engineer (Python, Spark, AWS)

Python
Java
Scala
MongoDB
Redis
  • Bachelor's Degree
  • At least 4 years of experience in application development
  • At least 2 years of experience in big data technologies
  • At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)
  • Experience with Python, SQL, Scala, or Java
  • Experience with distributed computing tools
  • Experience with NoSQL databases
  • Experience with UNIX/Linux
  • Experience with Agile engineering practices

Benefits For Lead Data Engineer (Python, Spark, AWS)

Medical Insurance
Dental Insurance
Vision Insurance
401k
  • Comprehensive health benefits
  • Financial benefits
  • Performance based incentive compensation
  • Cash bonuses
  • Long term incentives (LTI)

Interested in this job?

Jobs Related To Capital One Lead Data Engineer (Python, Spark, AWS)

Senior Lead Software Engineer, Data Management - Capital One Software

Senior Lead Software Engineer role at Capital One Software, building enterprise-grade data management solutions for cloud environments, requiring 12+ years of software development experience.

Lead Data Engineer (Python/Scala, Spark, AWS)

Lead Data Engineer position at Capital One working with Python, Scala, and AWS to build and maintain data infrastructure and pipelines.

Senior Lead Data Engineer (Bank Tech)

Senior Lead Data Engineer position at Capital One, leading data engineering initiatives and team development with focus on big data, cloud computing, and distributed systems.

Lead Data Engineer (Enterprise Platforms Technology)

Lead Data Engineer position at Capital One focusing on enterprise platforms technology, big data, and cloud computing with competitive compensation and benefits.

Lead Software Engineer, Data Management - Capital One Software

Lead Software Engineer position at Capital One Software focusing on building and maintaining data management solutions and products.