Staff Software Development Engineer - Data Platforms
Job Description
JioStar, a premier media and entertainment powerhouse reaching 750 million viewers weekly, is seeking a Staff Software Development Engineer for their Data Platforms team. This role sits at the intersection of big data and AI innovation, focusing on building next-generation data infrastructure that processes hundreds of millions of requests per minute and manages petabytes of data.
The position offers a unique opportunity to architect and develop the data foundations for cutting-edge AI initiatives, including the company's proprietary MCP server and AI Agents. You'll be working with state-of-the-art technologies across distributed systems, cloud platforms, and data processing frameworks, handling real-time data pipelines at massive scale.
As a technical leader, you'll own the entire development lifecycle, from ideation to deployment, while mentoring team members and driving best practices. The role combines deep technical expertise in data engineering with strategic thinking, as you'll be instrumental in making data-driven decisions that impact millions of users.
The ideal candidate brings 8+ years of progressive experience in data engineering, with proven expertise in distributed systems, cloud platforms, and modern data architectures. You'll need strong programming skills in languages like Python, Java, or Scala, and deep knowledge of data processing frameworks, messaging systems, and both SQL and NoSQL databases.
Working in a hybrid environment in Bengaluru, you'll be part of a team that's pushing the boundaries of what's possible with data and AI in the entertainment industry. This role offers the opportunity to work on challenging technical problems while directly impacting how millions of people consume entertainment and sports content.
Responsibilities For Staff Software Development Engineer - Data Platforms
- Build POCs, create architecture designs, and evaluate trade-offs for new services and migrations
- Build and maintain highly scalable real-time events collection systems
- Design and build data pipelines to support AI models and autonomous AI Agents
- Detect, alert, and fix data quality issues
- Improve existing systems using latest tooling and engineering standards
- Optimize costs across ingestion, storage, and processing components
- Own the entire development process from ideation to deployment
- Maintain technical documentation and architecture diagrams
- Establish monitoring, alerting, and operational procedures
- Mentor junior team members and share knowledge
Requirements For Staff Software Development Engineer - Data Platforms
- 8+ years of experience in data engineering
- Experience with systems handling hundreds of millions of events/minute
- Strong proficiency in Python, Java, Scala, or Go
- Expertise in distributed data processing frameworks (Apache Spark, Flink)
- Experience building data pipelines for ML model training
- Expertise with high-throughput messaging queues and stream processing
- Cloud platform expertise (AWS, GCP, or Azure)
- Experience with data warehousing and data lake architectures
- Strong SQL skills and database experience
- Advanced data modeling skills
- Excellent communication and collaboration skills
Related Jobs
