Big Data Developer
Description For Big Data Developer
We're seeking a Senior Big Data Developer for a leading global professional services firm with operations in over 150 countries. This role requires expertise in Spark, Scala, and cloud platforms (AWS/Azure/GCP) for developing and maintaining scalable data pipelines and backend services. The ideal candidate will have 6+ years of experience in Big Data development, strong proficiency in Java and Spring Boot, and expertise in implementing cloud-based big data solutions, particularly with Azure Data Lake Storage and Azure Databricks. You'll be responsible for designing and optimizing data processing pipelines, ensuring best practices in data security, and collaborating with cross-functional teams. The position offers competitive compensation, flexible working arrangements across multiple Indian locations, and the opportunity to work with cutting-edge technologies in a collaborative environment focused on innovation and excellence. This is an excellent opportunity for experienced data engineers looking to make an impact at a global scale while working with Fortune 500 companies and governments on complex challenges.
Responsibilities For Big Data Developer
- Develop, optimize, and maintain large-scale data processing pipelines using Apache Spark and Scala
- Implement and manage cloud-based big data storage and processing solutions on Azure Data Lake Storage (DLS) and Azure Databricks
- Collaborate with cross-functional teams to understand data requirements and deliver scalable backend services using Java and Spring Boot framework
- Ensure best practices in data security, performance optimization, and code quality
- Troubleshoot and resolve production issues related to big data workflows and backend services
- Continuously evaluate emerging technologies and propose enhancements to current systems
Requirements For Big Data Developer
- 6+ years of experience in Big Data development
- Strong expertise in Apache Spark and Scala for data processing
- Hands-on experience with cloud platforms such as AWS, Azure, or GCP, with a strong focus on Azure Data Lake Storage (DLS) and Azure Databricks
- Proficient in backend development using Java and Spring Boot framework
- Experience in designing and implementing scalable and fault-tolerant data pipelines
- Solid understanding of big data architectures, ETL processes, and data modeling
- Excellent problem-solving skills and ability to work in an agile environment
Benefits For Big Data Developer
- Competitive salary based on experience and skills
- Flexible working options with PAN India presence
- Opportunity to work with cutting-edge big data technologies
- Collaborative and supportive work culture with career growth opportunities
Jobs Related To Talent Worx Big Data Developer
