Software Development Engineer, Open Data Analytics - Engines

Amazon Web Services (AWS) is the world's most comprehensive and broadly adopted cloud platform, pioneering cloud computing and continuous innovation.
$129,300 - $223,600
Backend
Mid-Level Software Engineer
In-Person
5,000+ Employees
3+ years of experience
AI · Enterprise SaaS · Cloud

Description For Software Development Engineer, Open Data Analytics - Engines

Amazon Web Services Open Data Analytics (ODA) is seeking an experienced Software Development Engineer to join their core engines and datalake team. This role focuses on developing and optimizing AWS's cloud Big Data processing platform, particularly services like EMR and Athena. The position involves working with open source engines like Apache Spark and Trino, and datalake formats including Apache Iceberg, Hudi, and Delta.

The team has achieved significant performance improvements, enhancing engine efficiency by 5x through optimizations in query runtime, storage connectors, and compiler modifications. This strategic role requires collaboration with open-source communities, driving innovations in query engines and table format integrations.

As a key member of the Engines team, you'll shape technical direction, implement critical features, and work on performance optimizations. The role combines deep technical work with the opportunity to influence design decisions and foster collaboration across internal teams and the open-source community.

AWS Utility Computing provides foundational services like S3 and EC2, consistently innovating to maintain AWS's industry leadership. The position offers exposure to large-scale distributed systems, data analytics, and cutting-edge cloud technologies. You'll work in a startup-like environment, focusing on high-impact solutions for a global customer base.

The team values knowledge-sharing and mentorship, with senior members providing one-on-one guidance and thorough code reviews. AWS emphasizes career growth and diverse experiences, welcoming candidates from various backgrounds. The company promotes work-life harmony and offers comprehensive benefits including competitive compensation, equity opportunities, and medical coverage.

This role represents an opportunity to work on breakthrough technologies in cloud computing while contributing to open-source projects that shape the future of data analytics.

Last updated 11 minutes ago

Responsibilities For Software Development Engineer, Open Data Analytics - Engines

  • Develop and optimize core components of query engines and open table formats
  • Design and implement innovative solutions for table format integrations
  • Collaborate with open-source community
  • Ensure data consistency and durability
  • Improve automation and testing capabilities
  • Manage complex deliverables and research projects
  • Mentor team members
  • Handle challenging customer issues related to data lake workloads

Requirements For Software Development Engineer, Open Data Analytics - Engines

Java
  • 3+ years of non-internship professional software development experience
  • 2+ years of non-internship design or architecture experience
  • 3+ years of programming using modern programming languages (Java, C++, or C#)
  • Experience in object-oriented design

Benefits For Software Development Engineer, Open Data Analytics - Engines

Medical Insurance
401k
  • Full range of medical benefits
  • Financial benefits
  • Total compensation package

Interested in this job?

Jobs Related To Amazon Software Development Engineer, Open Data Analytics - Engines

Software Development Engineer, Amazon Business Catalog Tech

Software Development Engineer role at Amazon Business focusing on developing procurement and budget management solutions for B2B customers.

Software Development Engineer II, Amazon B2B Payments and Lending (ABPL)

Software Development Engineer II role at Amazon's B2B Payments and Lending team, building financial services solutions using AWS technologies in Bengaluru.

Software Dev Engineer II, Store Testing Foundations

Amazon is seeking a Software Dev Engineer II to join their Store Testing Foundations team to build and maintain automated testing infrastructure for the Amazon Store.

ADC Engineer II, S3+Glacier Unique Regions

AWS ADC Engineer II position for S3+Glacier Unique Regions, focusing on cloud storage solutions for government customers, requiring TS/SCI clearance and strong systems administration experience.

Software Development Engineer in Test II, Global Logistics Tech, Quality Assurance

Lead software test automation engineer role at Amazon focusing on quality assurance for global logistics systems, offering competitive salary and comprehensive benefits.