Lead Software Engineer (Lead ETL PySpark Developer)
Description For Lead Software Engineer (Lead ETL PySpark Developer)
Clarivate is seeking a Lead ETL Developer to join their C3 Data team in Bangalore. This role focuses on the Clarivate Customer Cloud (C3) platform, making rich content available to all customers. The position involves working with cutting-edge big data technologies including Python, PySpark, Spark, Databricks, ECS, AWS, and Airflow. The C3 Data team consists of over 50 global experts working on data access for products and consulting-led engagements. The role offers an opportunity to work with modern data technologies, lead technical initiatives, and mentor team members while building and maintaining data lake platforms. This is a permanent position based in Bangalore working IST hours, offering a hybrid work environment and the chance to work with a global leader in trusted intelligence and analytics solutions.
Responsibilities For Lead Software Engineer (Lead ETL PySpark Developer)
- Providing technical leadership and guidance, evaluating various technologies
- Collaborating with business and IT teams to design and implement a data lake platform
- Maintaining the overall solution architecture for the data lake platform
- Establishing technical best practices for big data management and solutions
- Ensuring all components of the data lake platform meet SLAs
- Leading technical investigations, POCs, and hands-on coding
- Mentoring and coaching team members
Requirements For Lead Software Engineer (Lead ETL PySpark Developer)
- At least 5+ years of experience in building ETL pipelines and proficiency in PySpark
- At least 2 years of proficient in Python3 and experience with Databricks and Apache Spark
- Strong SQL and non-SQL database skills
- Passionate about code and software architecture
Jobs Related To Clarivate Lead Software Engineer (Lead ETL PySpark Developer)
