Taro Logo

Applied Research Engineer – LLM Training (f/m/d)

Aleph Alpha develops foundational AI models and next-generation methods for industrial applications in finance, administration, R&D, logistics, and manufacturing processes.
69 Heidelberg, GermanyBerlin, Germany
Machine Learning
Senior Software Engineer
Hybrid
101 - 500 Employees
5+ years of experience
AI

Job Description

Aleph Alpha Research is seeking an experienced Applied Research Engineer to join their Frontier LLM Research Engineering team. This role sits at the intersection of research and engineering, focusing on advancing the development of foundational AI models. The position involves conducting experiments across the entire lifecycle of model training, including proposing novel LLM architectures, datamixes, and evaluations.

The ideal candidate will have a strong background in both AI science and software engineering, with experience in distributed training, deep learning, and production-level model deployment. They will be responsible for developing large-scale training pipelines, researching novel approaches for foundation models, and contributing to the company's research publications.

Working at Aleph Alpha offers the opportunity to be part of cutting-edge AI development while contributing to technological sovereignty. The company provides a collaborative environment with direct access to international experts, the ability to publish research, and a comprehensive benefits package including flexible working arrangements, mental health support, and various financial perks.

The position requires a blend of technical expertise and research capabilities, with preferred qualifications including a PhD in machine learning and experience with GPU programming. The role offers the flexibility of working from either Heidelberg or Berlin in a hybrid setup, with the company covering travel expenses for occasional onsite work at their Research HQ in Heidelberg.

This is an excellent opportunity for someone passionate about advancing the field of AI while working on practical applications that will shape the future of industrial AI implementation.

Last updated 11 hours ago

Responsibilities For Applied Research Engineer – LLM Training (f/m/d)

  • Research and develop novel approaches for training foundation models
  • Develop large-scale distributed training and data generation pipelines
  • Analyze and benchmark state-of-the-art LLM research approaches
  • Collaborate with scientists, engineers, and external partners
  • Publish research work and release code and models

Requirements For Applied Research Engineer – LLM Training (f/m/d)

Python
  • Experience in distributed training, training data, or model architectures
  • Advanced knowledge of transformers and deep learning concepts
  • Strong software engineering skills in Python and PyTorch
  • Experience with shipping production-ready models
  • Proven ability to apply scientific methods to novel problems
  • PhD in machine learning or related fields preferred
  • Experience with GPU kernels (CUDA, Triton) preferred
  • Strong collaborative and interpersonal skills

Benefits For Applied Research Engineer – LLM Training (f/m/d)

Mental Health Assistance
Vision Insurance
Medical Insurance
Dental Insurance
401k
Equity
  • 30 days paid vacation
  • Fitness & wellness offerings via Wellhub
  • Mental health support through nilo.health
  • Subsidized company pension plan
  • Subsidized Germany-wide transportation ticket
  • Budget for technical equipment
  • Flexible working hours
  • Virtual Stock Option Plan
  • Bike Lease program

Related Jobs

Senior Deep Learning Compiler Engineer - PyTorch

Senior Deep Learning Compiler Engineer position at NVIDIA, focusing on developing Thunder compiler for PyTorch optimization on NVIDIA GPUs.

Senior AI Engineer

Senior AI Engineer position at Docker, focusing on developing AI-powered developer tools and enhancing the Ask Gordon AI assistant using LLMs and RAG systems.

Senior AI Engineer

Senior AI Engineer position at Covestro, focusing on implementing and scaling machine learning solutions with competitive compensation between $104,800-$127,100 annually.

Senior AI Engineer

Senior AI Engineer position at Covestro, focusing on ML model deployment and scaling, offering €104,800 - €127,100/year plus benefits in Leverkusen, Germany.

Senior Developer Technology Engineer - Windows LLM & GenAI Open-Source Ecosystem

Senior Developer Technology Engineer role at NVIDIA focusing on Windows LLM & GenAI open-source ecosystem optimization and development.