Software Development Engineer, Open Data Analytics Engines - Spark

Amazon Web Services (AWS) is the world's most comprehensive and broadly adopted cloud platform, pioneering cloud computing.
$129,300 - $223,600
Backend
Mid-Level Software Engineer
In-Person
5,000+ Employees
3+ years of experience
Enterprise SaaS · AI

Description For Software Development Engineer, Open Data Analytics Engines - Spark

Join Amazon Web Services (AWS) as a Software Development Engineer on the analytics team's core engines team. This role focuses on enhancing Athena and EMR services that enable large-scale analytics using open source engines like Trino and Spark. The team has achieved impressive 5x performance improvements through optimizations in query runtime, storage connectors, and compiler modifications.

As a key member of the engines team, you'll work on critical features and performance optimizations for query engines, particularly focusing on Spark integration with AWS services. This position is part of AWS's Utility Computing (UC) organization, which delivers foundational services like S3 and EC2, along with continuous innovations in cloud computing.

The role offers excellent growth opportunities within AWS, the world's leading cloud platform. You'll contribute to a strategic area that directly impacts enterprise-scale analytics capabilities. The team culture emphasizes work-life harmony, diversity, and continuous learning through employee-led affinity groups and mentorship programs.

The compensation package includes a competitive base salary range of $129,300-$223,600 depending on location, plus equity, sign-on payments, and comprehensive benefits. You'll be working with cutting-edge technology while helping shape the future of cloud analytics at AWS.

This position requires strong software development skills, system design experience, and the ability to work effectively with open source communities. If you're passionate about large-scale distributed systems and want to make an impact on how businesses handle data analytics, this role offers an excellent opportunity to work with industry-leading technology at global scale.

Last updated 2 minutes ago

Responsibilities For Software Development Engineer, Open Data Analytics Engines - Spark

  • Hands-on development for core components of the query engine
  • Design and develop solutions and algorithms to improve the performance of Spark
  • Design and develop improvements to the AWS Runtime for Spark's integration with other AWS services
  • Manage complex deliverables project and research projects with deadlines
  • Ensure data consistency and durability with breakthrough performance and scalability
  • Interact and partner with the open source community

Requirements For Software Development Engineer, Open Data Analytics Engines - Spark

Java
Python
  • 3+ years of non-internship professional software development experience
  • 2+ years of non-internship design or architecture experience
  • Experience programming with at least one software programming language

Benefits For Software Development Engineer, Open Data Analytics Engines - Spark

Medical Insurance
401k
  • Medical Insurance
  • 401k

Interested in this job?

Jobs Related To Amazon Software Development Engineer, Open Data Analytics Engines - Spark

Software Development Engineer, Devices Retail Inventory and Financial Record Keeping Technology (DRIFT)

Software Development Engineer role at Amazon's DRIFT team, focusing on retail inventory and financial record-keeping technology for Amazon's device sales through brick-and-mortar retailers worldwide.

Software Development Engineer, S3

Software Development Engineer position at Amazon S3 team, working on cloud storage solutions and services.

Software Development Engineer, EC2 VPC, NEAT Engineering Safety

AWS seeks Software Development Engineer for EC2 VPC team to build cloud networking automation, requiring 3+ years experience in software development and system architecture.

Software Development Engineer II - Alexa Customers & Devices

Software Development Engineer II position at Amazon's Alexa Customers & Devices team, focusing on building cross-platform software for device management and supply chain operations.

Software Development Engineer II, Appstore

Software Development Engineer II position at Amazon Appstore team, focusing on building developer tools, SDKs and services for mobile app developers.