Data Engineer II, ATLAS Data Engineering

Amazon Security (AmSec) is seeking a Data Engineer II to join their ATLAS Data Engineering team, focusing on resource and application discovery initiatives. The role is centered around working with Veritas, a foundational security service that provides critical data for various security operations. The position involves handling large-scale data processing, with daily volumes exceeding 1TB across 500+ datasets.

The role combines technical expertise with strategic thinking, requiring proficiency in AWS services like EMR, Glue, Athena, Redshift, and modern AI tools like Bedrock. You'll be responsible for building scalable ETL pipelines, implementing data governance strategies, and optimizing data processing systems.

Working in a diverse, global team spanning ten countries, you'll collaborate with Software Engineers, Data Scientists, and Security Engineers to deliver high-quality datasets for security investigations and application modeling. The position offers significant growth opportunities within Amazon's security infrastructure, with exposure to various security domains including threat modeling, incident response, and access control.

The ideal candidate will thrive in a fast-paced environment, handling complex systems while maintaining high standards for data quality and operational excellence. This role offers competitive compensation, comprehensive benefits, and the opportunity to work on critical security infrastructure at one of the world's leading technology companies.

Key technologies include AWS services, Apache Airflow, and various big data processing tools. The role combines technical depth with business impact, making it ideal for those interested in both data engineering and security infrastructure.