Sr Data Engineer, OTS DataTech & Learning Solutions

At OpsTech Solutions (OTS), we are a technology centric services organization that designs, builds, and sustains the invisible, high-quality network, compute infrastructure and device scaffolding that empowers and protects Amazon's global Operations. The OTS DataTech team drives the enterprise data strategy, focusing on Data as a Product and supporting OTS-wide efforts, including generative AI and machine learning capabilities to fuel innovation and automation across the OTS product portfolio.

As a Sr Data Engineer on the DataTech team, you will play a critical role in designing and building the foundational data infrastructure components that empowers OTS product teams with business critical metrics, develop systems and tools to ingest data from diverse data sources, enable seamless data publish, subscribe, and self-service analytics for business metrics reporting. You will participate in automation of data governance and data quality monitoring processes, support data needs for AI/ML and Gen AI capabilities.

On a day-to-day basis, you will build and operate a highly scalable data mesh infrastructure that supports data needs for the OTS organization through self-service Data as a Product.

Key Responsibilities:

• Design and build foundational data infrastructure components
• Develop systems and tools for data ingestion from diverse sources
• Enable seamless data publishing, subscription, and self-service analytics
• Automate data governance and quality monitoring processes
• Support data needs for AI/ML and Gen AI capabilities
• Build and operate scalable data mesh infrastructure

Required Qualifications:

• 5+ years of data engineering experience
• Experience with data modeling, warehousing, and building ETL pipelines
• Proficiency in SQL
• Experience in at least one modern scripting or programming language (Python, Java, Scala, or NodeJS)
• Experience mentoring team members on best practices

Preferred Qualifications:

• Experience with big data technologies (Hadoop, Hive, Spark, EMR)
• Experience operating large data warehouses
• Experience developing on AWS EMR, Glue, Airflow, etc.

Amazon is committed to diversity and inclusion, providing equal opportunities regardless of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status.