Software Development Engineer, Open Data Analytics - Engines (Level 5), Open Data Analytics Engines

World's most comprehensive and broadly adopted cloud platform, pioneering cloud computing and continuous innovation.
$129,300 - $223,600
Backend
Senior Software Engineer
In-Person
5,000+ Employees
3+ years of experience
Enterprise SaaS · AI

Description For Software Development Engineer, Open Data Analytics - Engines (Level 5), Open Data Analytics Engines

Amazon Web Services Open Data Analytics (ODA) is seeking an experienced Senior Software Engineer to join their core engines and datalake team. This strategic role focuses on developing and optimizing cloud Big Data processing platforms like EMR and Athena, working with open-source engines such as Apache Spark and Trino, and datalake formats including Apache Iceberg, Hudi, and Delta.

The position offers an opportunity to make significant impact by improving engine performance, implementing enterprise features, and contributing to open-source communities. In the past three years, the team has achieved 5x performance improvements through optimizations in query runtime, storage connectors, and compiler modifications.

As a key member of the Engines team, you'll shape technical direction, drive innovations in query engines and table format integrations, and collaborate with both internal teams and open-source communities. The role involves working on performance optimizations, feature enhancements, stability improvements, and security hardening.

AWS values diverse experiences and maintains an inclusive culture through employee-led affinity groups and ongoing learning experiences. The company offers comprehensive benefits, mentorship opportunities, and emphasizes work-life harmony. This position is part of AWS Utility Computing, which provides foundational services like S3 and EC2, along with continuous product innovations.

The ideal candidate will have strong software development experience, system architecture knowledge, and the ability to manage complex projects while mentoring team members. This is a unique opportunity to work on cutting-edge big data technologies while contributing to open-source projects that impact the broader tech community.

Last updated a few seconds ago

Responsibilities For Software Development Engineer, Open Data Analytics - Engines (Level 5), Open Data Analytics Engines

  • Develop and optimize core components of query engines and open table formats
  • Design and implement innovative solutions for table format integrations
  • Collaborate with open-source community
  • Ensure data consistency and durability
  • Improve automation and testing capabilities
  • Manage complex deliverables and research projects
  • Mentor and train team members
  • Handle challenging customer issues related to data lake workloads

Requirements For Software Development Engineer, Open Data Analytics - Engines (Level 5), Open Data Analytics Engines

Java
Python
  • 3+ years of non-internship professional software development experience
  • 2+ years of non-internship design or architecture experience
  • Experience programming with at least one software programming language
  • Experience with design patterns, reliability and scaling of systems

Benefits For Software Development Engineer, Open Data Analytics - Engines (Level 5), Open Data Analytics Engines

Medical Insurance
401k
  • Full range of medical benefits
  • Financial benefits
  • Employee-led affinity groups
  • Mentorship opportunities
  • Career development resources
  • Work-life harmony
  • Flexible working culture

Interested in this job?

Jobs Related To Amazon Software Development Engineer, Open Data Analytics - Engines (Level 5), Open Data Analytics Engines

Senior Quality Assurance Engineer

Senior QA Engineer role at Audible, focusing on test automation and quality strategy for audio content delivery platform, requiring 4+ years experience in QA/SDET.

Senior Network Development Engineer - Wireless Networks, Kuiper Enterprise Technology, Kuiper Builder Engagement

Senior Network Development Engineer role at Amazon Kuiper, focusing on wireless network design and implementation for satellite broadband infrastructure.

Senior Software Development Engineer, Virtual Systems Core

Senior Software Development Engineer role at Amazon Robotics, focusing on building high-performance simulations for robotic solutions and core infrastructure development.

Sr. Software Development Engineer, Ads Marketing

Senior Software Development Engineer position at Amazon's Advertising division, focusing on building scalable marketing technology solutions for advertisers worldwide.

Sr. Software Development Engineer, Device Club Team

Senior Software Engineer position at Ring/Amazon focusing on building scalable device health monitoring services using AWS technologies, offering competitive compensation and benefits.