Sr Software Development Engineer

AWS AI is seeking exceptional software developers to join their Deep Learning cross-framework team. This role focuses on developing extensions for TensorFlow and PyTorch machine learning frameworks and creating cross-framework solutions for large-scale Deep Learning model training.

Key responsibilities include:

• Developing innovative solutions for Large Language Model training across node clusters
• Implementing model parallelism methods including pipeline and tensor parallelism
• Creating memory optimization techniques like activation checkpointing/offloading
• Optimizing distributed training through performance analysis and bottleneck resolution
• Enhancing communication collectives for AWS network infrastructure

The position is within the SageMaker Engines team, which specializes in developing technology for large-scale Deep Learning model training. The role combines cutting-edge machine learning infrastructure development with high-performance computing optimization.

AWS offers comprehensive benefits including:

• Competitive compensation with base pay ranging from $151,300 to $261,500 annually
• Equity compensation and sign-on payments
• Complete medical, financial, and additional benefits
• Strong focus on work-life harmony and flexible working culture
• Extensive career development opportunities and mentorship
• Inclusive team culture with employee-led affinity groups

The role provides an opportunity to work with industry leaders in a fast-paced, innovative environment while contributing to AWS's position as a thought leader in cloud computing and artificial intelligence.