Taro Logo

Lead Java PySpark Developer

A technology company specializing in data engineering and analytics solutions.
Dallas, TX, USAPittsburgh, PA, USACleveland, OH, USA
Data
Staff Software Engineer
Remote
6+ years of experience
Enterprise SaaS · Finance

Description For Lead Java PySpark Developer

Incedo is seeking an experienced Lead Java PySpark Developer to join their data engineering team. This role combines advanced data engineering with distributed systems development, focusing on building scalable data pipelines and microservices for analytics and business insights platforms.

The position requires a strong background in both Java development (6+ years) and PySpark (3+ years), with expertise in big data technologies including the Hadoop ecosystem. The ideal candidate will work at the intersection of data processing and service architecture, building robust solutions for financial services applications.

As a Lead Developer, you'll be responsible for designing and implementing data processing pipelines, creating microservices for data integration, and providing technical leadership to the team. The role involves working with cutting-edge technologies in distributed computing, while ensuring high performance and security standards are maintained.

The position offers the flexibility of remote work with the backing of an established company in the financial technology sector. You'll be part of a collaborative environment, working alongside data scientists and analysts to deliver impactful solutions. This is an excellent opportunity for a senior developer looking to advance their career in data engineering while working with modern technologies and architectures.

The role requires a blend of technical expertise and leadership skills, making it ideal for someone who enjoys both hands-on development and guiding technical decisions. You'll be working with a comprehensive tech stack including Java, PySpark, Hadoop, and cloud technologies, with the opportunity to influence architectural decisions and best practices.

Last updated 3 days ago

Responsibilities For Lead Java PySpark Developer

  • Design, develop, and maintain scalable data processing pipelines using PySpark on big data platforms
  • Build and enhance Java-based microservices/APIs to support data ingestion and transformation
  • Collaborate with data scientists, data analysts, and architects
  • Optimize data workflows and troubleshoot performance bottlenecks
  • Participate in code reviews, design discussions, and provide technical leadership
  • Implement data validation, quality checks, and error-handling mechanisms
  • Ensure adherence to data security and compliance standards within financial environments

Requirements For Lead Java PySpark Developer

Java
Python
  • 6+ years of hands-on experience in Java (Spring Boot preferred)
  • 3+ years of experience with PySpark in distributed data processing
  • Experience with Hadoop ecosystem, Hive, HDFS, and Spark SQL
  • Solid understanding of RESTful APIs, JSON/XML, and integration patterns
  • Strong knowledge of SQL and data modeling
  • Familiarity with CI/CD tools, Git, and Agile methodology
  • Bachelor's or Master's degree in Computer Science, Information Technology, or related field

Interested in this job?

Jobs Related To Qode Lead Java PySpark Developer