Taro Logo

Lead Data Engineer (Python, Spark, Airflow)

A leading information-based technology company focused on banking, founded and led by Richard Fairbank.
McLean, VA, USA
$193,400 - $220,700
Data
Staff Software Engineer
In-Person
5,000+ Employees
4+ years of experience
Finance

Job Description

Capital One is seeking a Lead Data Engineer to join their technology transformation initiative. This role combines data engineering expertise with emerging technologies, offering an opportunity to work on complex business problems in a collaborative environment. The position involves working with machine learning, distributed microservices, and full-stack systems, utilizing various programming languages and technologies. The ideal candidate will have extensive experience in application development, big data technologies, and cloud computing. They'll be responsible for designing and implementing technical solutions, mentoring team members, and staying current with technology trends. The role offers competitive compensation ($193,400 - $220,700) and comprehensive benefits. Capital One, a leading information-based technology company, is committed to bringing ingenuity and humanity to banking under the leadership of founder Richard Fairbank. The company offers a collaborative, inclusive environment where engineers can make significant impacts while working with cutting-edge technologies. This position represents an excellent opportunity for experienced data engineers looking to work on transformative projects at scale while contributing to financial technology innovation.

Last updated 2 days ago

Responsibilities For Lead Data Engineer (Python, Spark, Airflow)

  • Collaborate with Agile teams to design, develop, test, implement, and support technical solutions
  • Work with machine learning, distributed microservices, and full stack systems
  • Utilize programming languages and databases including Java, Scala, Python, RDBMS, NoSQL
  • Stay current with tech trends and mentor other engineers
  • Collaborate with product managers to deliver cloud-based solutions
  • Perform unit tests and code reviews

Requirements For Lead Data Engineer (Python, Spark, Airflow)

Python
Java
Scala
Kafka
MongoDB
  • Bachelor's Degree
  • At least 4 years of experience in application development
  • At least 2 years of experience in big data technologies
  • At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)
  • Experience with Python, SQL, Scala, or Java preferred
  • Experience with distributed computing tools preferred
  • Experience with NoSQL databases preferred
  • Experience with UNIX/Linux preferred
  • Experience with Agile engineering practices preferred

Benefits For Lead Data Engineer (Python, Spark, Airflow)

Medical Insurance
Dental Insurance
Vision Insurance
401k
  • Comprehensive health benefits
  • Financial benefits
  • Performance based incentive compensation
  • Cash bonuses
  • Long term incentives (LTI)

Related Jobs