Amazon Web Services Open Data Analytics (ODA) is seeking an experienced Software Development Engineer to join their core engines and datalake team. This role focuses on developing and optimizing AWS's cloud Big Data processing platform, particularly services like EMR and Athena. The position involves working with open source engines like Apache Spark and Trino, and datalake formats including Apache Iceberg, Hudi, and Delta.
The team has achieved significant performance improvements, enhancing engine efficiency by 5x through optimizations in query runtime, storage connectors, and compiler modifications. This strategic role requires collaboration with open-source communities, driving innovations in query engines and table format integrations.
As a key member of the Engines team, you'll shape technical direction, implement critical features, and work on performance optimizations. The role combines deep technical work with the opportunity to influence design decisions and foster collaboration across internal teams and the open-source community.
AWS Utility Computing provides foundational services like S3 and EC2, consistently innovating to maintain AWS's industry leadership. The position offers exposure to large-scale distributed systems, data analytics, and cutting-edge cloud technologies. You'll work in a startup-like environment, focusing on high-impact solutions for a global customer base.
The team values knowledge-sharing and mentorship, with senior members providing one-on-one guidance and thorough code reviews. AWS emphasizes career growth and diverse experiences, welcoming candidates from various backgrounds. The company promotes work-life harmony and offers comprehensive benefits including competitive compensation, equity opportunities, and medical coverage.
This role represents an opportunity to work on breakthrough technologies in cloud computing while contributing to open-source projects that shape the future of data analytics.