Software Development Engineer, Open Data Analytics - Engines

Amazon Web Services (AWS) Open Data Analytics (ODA) organization is seeking a Senior Software Engineer to join their core engines and datalake team. This role focuses on developing and optimizing AWS's cloud Big Data processing platform, particularly services like EMR and Athena.

The position involves working with open-source engines like Apache Spark and Trino, alongside datalake open table formats including Apache Iceberg, Hudi, and Delta. The team has achieved significant performance improvements, enhancing engine efficiency by 5x through optimizations in query runtime, storage connectors, and compiler modifications.

This is a strategic role where you'll collaborate closely with open-source communities, driving innovations in query engines and table format integrations. The position offers an opportunity to shape technical direction, influence design decisions, and make substantial contributions to both proprietary and open-source codebases.

AWS, as part of Amazon's Utility Computing organization, provides foundational services like S3 and EC2, consistently innovating to maintain industry leadership. The role combines technical depth with strategic importance, requiring both hands-on engineering expertise and collaborative skills.

The position offers comprehensive benefits, including medical coverage, financial benefits, and emphasis on work-life harmony. AWS values diverse experiences and fosters an inclusive culture through employee-led affinity groups and ongoing learning opportunities. The company provides strong career development support through mentorship and knowledge-sharing programs.

This role is ideal for experienced engineers passionate about distributed systems, big data processing, and open-source collaboration. You'll work on challenging technical problems while having the opportunity to influence the direction of critical data processing services used by customers worldwide.