Amazon Web Services Open Data Analytics (ODA) is seeking an experienced Senior Software Engineer to join their core engines and datalake team. This strategic role focuses on developing and optimizing cloud Big Data processing platforms like EMR and Athena, working with open-source engines such as Apache Spark and Trino, and datalake formats including Apache Iceberg, Hudi, and Delta.
The position offers an opportunity to make significant impact by improving engine performance, implementing enterprise features, and contributing to open-source communities. In the past three years, the team has achieved 5x performance improvements through optimizations in query runtime, storage connectors, and compiler modifications.
As a key member of the Engines team, you'll shape technical direction, drive innovations in query engines and table format integrations, and collaborate with both internal teams and open-source communities. The role involves working on performance optimizations, feature enhancements, stability improvements, and security hardening.
AWS values diverse experiences and maintains an inclusive culture through employee-led affinity groups and ongoing learning experiences. The company offers comprehensive benefits, mentorship opportunities, and emphasizes work-life harmony. This position is part of AWS Utility Computing, which provides foundational services like S3 and EC2, along with continuous product innovations.
The ideal candidate will have strong software development experience, system architecture knowledge, and the ability to manage complex projects while mentoring team members. This is a unique opportunity to work on cutting-edge big data technologies while contributing to open-source projects that impact the broader tech community.