Scala/Spark Developer with Big Data– AVP – C12
Description For Scala/Spark Developer with Big Data– AVP – C12
Citi's Commercial Card's Global Data Repository development team is seeking an experienced Spark and Big Data ETL Tech Lead. This role offers an opportunity to work on enterprise-level global applications in a leading financial institution. The position involves leading the design and implementation of large-scale data processing pipelines using cutting-edge technologies like Apache Spark on BigData Hadoop Platform.
The role combines technical leadership with team management, requiring someone who can both architect complex solutions and lead teams of 5-15 developers. You'll be working with various data technologies including Couchbase, Snowflake, HBase, and will be responsible for ensuring data quality and consistency across systems.
This is an excellent opportunity for a seasoned professional with strong technical skills in Scala, Spark, and big data technologies, combined with leadership experience. The role offers visibility at senior levels and the chance to work on globally distributed projects that impact Citi's global operations.
The position requires someone who can thrive in a fast-paced environment, manage multiple priorities, and communicate effectively with both technical teams and business stakeholders. You'll be working in a diverse, collaborative environment while helping to shape the future of Citi's data infrastructure.
Key aspects of the role include mentoring junior developers, staying current with the latest trends in big data and cloud computing, and ensuring compliance with Citi's System Development Lifecycle and Information Security requirements. The ideal candidate will bring both technical expertise and strong leadership skills to help drive innovation and excellence in Citi's data solutions.
Responsibilities For Scala/Spark Developer with Big Data– AVP – C12
- Lead design and implementation of large-scale data processing pipelines using Apache Spark on BigData Hadoop Platform
- Develop and optimize Spark applications for performance and scalability
- Provide technical leadership for multiple large scale/complex global software solutions
- Integrate data from various sources including Couchbase, Snowflake, and HBase
- Lead teams of 5-15 developers
- Design, code, test, document and implement application release projects
- Work with onsite development partners to ensure best practices
- Monitor and communicate project timelines and milestones
- Mentor and guide junior developers
Requirements For Scala/Spark Developer with Big Data– AVP – C12
- Bachelor's or master's degree in Computer Science, Information Technology, or equivalent
- 10+ years of experience in developing and managing big data solutions using Apache Spark
- 6+ years of experience leading globally distributed teams
- Strong programming skills in Scala, Java, or Python
- Experience with Apache Hive, Apache Kafka, HBase, Couchbase, Sqoop, Flume
- Proficiency in SQL and experience with Oracle/PL-SQL and NoSQL databases
- Experience in building enterprise systems focusing on recovery, stability, reliability, scalability
- Knowledge of data modeling, data architecture, and data integration techniques
- Excellent communication and organizational skills
