Sr. Data Engineer - (Big Data, Spark, Scala, Python, AWS, RDBMS, SQL)

Nielsen provides powerful insights that drive client decisions in media measurement and audience engagement across all platforms.
Data
Senior Software Engineer
Hybrid
5,000+ Employees
4+ years of experience
Enterprise SaaS · AI
This job posting may no longer be active. You may be interested in these related jobs instead:
Sr. Software Engineer, Big Data

Senior Software Engineer position at Pinterest focusing on Big Data infrastructure, data warehousing, and analytics systems at petabyte scale.

Senior Software Engineer - Data Platform

Senior Software Engineer position at Samsara focused on building and maintaining data platform infrastructure, requiring expertise in Spark, AWS, and large-scale data systems.

Senior Software Engineer - Data Infrastructure

Senior Software Engineer position at Roblox focusing on building and scaling data infrastructure systems, offering $233,840 - $283,780 salary range with comprehensive benefits in San Mateo, CA.

Senior Software Engineer-Data Platform

Senior Software Engineer position at Roblox focusing on building scalable data platform infrastructure using Apache Spark and Flink, offering $289K-$338K salary with comprehensive benefits.

Senior Data Engineer

Senior Data Engineer position at Disney in Glendale, CA

Description For Sr. Data Engineer - (Big Data, Spark, Scala, Python, AWS, RDBMS, SQL)

Nielsen, a global leader in media measurement and analytics, is seeking a Senior Data Engineer to join their technology team. This role presents an exciting opportunity to work at the forefront of media measurement technology, helping to power better media futures through data-driven insights.

The position combines big data processing, cloud architecture, and distributed systems expertise, requiring proficiency in technologies like Apache Spark, Scala, and AWS. As a Senior Data Engineer, you'll be responsible for building scalable, reliable, and cost-effective solutions that handle massive datasets and complex analytics pipelines.

The role offers a unique blend of technical challenges and leadership opportunities. You'll work on implementing end-to-end solutions in big data analytics, while also mentoring junior team members and collaborating with data scientists to translate complex methodologies into engineering solutions. The position requires 4-8 years of experience, with at least 3 years focused on big data processing using Apache Spark.

Nielsen offers a hybrid work environment and the chance to work with cutting-edge technologies. You'll be part of a dynamic team that values continuous learning and innovation. The company's strong legacy in media measurement, combined with its forward-thinking approach to technology, makes this an ideal opportunity for a senior engineer looking to make a significant impact in the media analytics space.

Key technical requirements include expertise in Java/Scala, Big Data technologies (Hadoop, Spark, Spark SQL), cloud platforms (preferably AWS), and various data storage solutions (PostgreSQL, Cassandra, Elasticsearch). The role also demands strong problem-solving abilities and excellent communication skills, as you'll be working closely with product owners and cross-functional teams.

This position is perfect for someone who enjoys tackling complex technical challenges while having the opportunity to mentor others and influence technical direction. You'll be at the intersection of big data, cloud computing, and media analytics, helping Nielsen maintain its position as a leader in audience measurement and analytics.

Last updated 8 days ago

Responsibilities For Sr. Data Engineer - (Big Data, Spark, Scala, Python, AWS, RDBMS, SQL)

  • Build scalable, reliable, cost-effective solutions for Cloud and on-premises
  • Build and test Cloud-based applications for new and existing backend systems
  • Build platform reusable code and components for multiple project teams
  • Implement end-to-end solutions with sound technical architecture in Big Data analytics framework
  • Drive innovative solutions within the platform
  • Develop design specifications and deployment strategy for Agile methodology
  • Provide cloud integration development support
  • Build rapid technical prototypes
  • Collaborate with Data Science team and product owners
  • Mentor junior team members
  • Stay informed about latest technology trends

Requirements For Sr. Data Engineer - (Big Data, Spark, Scala, Python, AWS, RDBMS, SQL)

Scala
Java
Python
PostgreSQL
Cassandra
Kafka
  • Bachelor's degree in computer science, engineering with 4-8 years of experience
  • Strong cloud Implementation expertise in cloud architecture
  • Strong analytical and technical skills in troubleshooting
  • 3+ years experience in big data using Apache Spark
  • Experience in AWS Cloud with automation technologies
  • Experience in Java or Scala, Big Data, Hadoop, Spark, Spark SQL
  • Strong knowledge of Unix/Linux OS, commands, shell scripting, python
  • Experience with Apache Airflow or similar tools
  • Strong knowledge in AWS services (S3, EC2, EMR, Lambda)
  • Experience with data warehouses or data lakes
  • Very strong verbal and written communication skills
  • AWS Certification is a plus

Interested in this job?