AWS Data Engineer - Sr Consultant
Description For AWS Data Engineer - Sr Consultant
Talent Worx is seeking an experienced AWS Data Engineer to join their team in a Senior Consultant role, working with one of the Big 4 firms in India. This position offers a hybrid work arrangement across multiple major Indian cities. The role focuses on designing and implementing robust data pipelines and analytics solutions using AWS services, requiring 5-8 years of experience. The ideal candidate will work with cutting-edge technologies including AWS Glue, EMR, Lambda, and various database systems. They will be responsible for building scalable data architectures, optimizing ETL processes, and ensuring data quality and security. This position offers an opportunity to work on significant projects while collaborating with data scientists and analysts. The role requires strong technical skills in Python, PySpark, and SQL, combined with extensive AWS experience. This is an excellent opportunity for experienced data engineers looking to work with enterprise-level clients and complex data solutions.
Responsibilities For AWS Data Engineer - Sr Consultant
- Design and implement scalable, high-performance data pipelines using AWS services
- Develop and optimize ETL processes using AWS Glue, EMR, and Lambda
- Build and maintain data lakes using S3 and Delta Lake
- Create and manage analytics solutions using Amazon Athena and Redshift
- Design and implement database solutions using Aurora, RDS, and DynamoDB
- Develop serverless workflows using AWS Step Functions
- Write efficient and maintainable code using Python/PySpark, and SQL/PostgrSQL
- Ensure data quality, security, and compliance with industry standards
- Collaborate with data scientists and analysts to support their data needs
- Optimize data architecture for performance and cost-efficiency
- Troubleshoot and resolve data pipeline and infrastructure issues
Requirements For AWS Data Engineer - Sr Consultant
- Bachelor's degree in computer science, Information Technology, or related field
- 5-8 years of experience as a Data Engineer, with at least 60% of experience focusing on AWS
- Strong proficiency in AWS data services: Glue, EMR, Lambda, Athena, Redshift, S3
- Experience with data lake technologies, particularly Delta Lake
- Expertise in database systems: Aurora, RDS, DynamoDB, PostgreSQL
- Proficiency in Python and PySpark programming
- Strong SQL skills and experience with PostgreSQL
- Experience with Big Data technologies: Hadoop, Spark, Delta Lake
- Knowledge of ETL/ELT processes
- Experience with version control: Git
- Understanding of Agile methodologies
Benefits For AWS Data Engineer - Sr Consultant
- Work with one of the Big 4's in India
Jobs Related To Talent Worx AWS Data Engineer - Sr Consultant
