Taro Logo

Senior Developer Technology Engineer - Windows LLM & GenAI Open-Source Ecosystem

NVIDIA is the world leader in accelerated computing, pioneering visual computing and GPU technology.
70 Stuttgart, GermanyMunich, GermanyBerlin, Germany
Machine Learning
Senior Software Engineer
Hybrid
5,000+ Employees
5+ years of experience
AI · Enterprise SaaS

Job Description

NVIDIA, a pioneer in visual computing and GPU technology for over two decades, is seeking a Senior Developer Technology Engineer to join their team in Germany. This role focuses on advancing the LLM & GenAI open-source ecosystem for Windows AI developers. The position combines deep technical expertise in GPU computing with AI/ML development, specifically targeting large language models and generative AI applications.

The ideal candidate will work at the intersection of high-performance computing and artificial intelligence, improving the performance and functionality of open-source AI software on NVIDIA RTX platforms. They will collaborate with both internal teams and external partners to optimize AI model deployment on local workstations, using advanced techniques like quantization and distillation.

This is an excellent opportunity for an experienced engineer who is passionate about AI technology and wants to impact the future of local AI computing. The role offers the chance to work with cutting-edge technology, influence next-generation GPU features, and contribute to the broader AI developer community through training and documentation.

The position requires strong technical skills in GPU computing, AI frameworks, and software development, combined with excellent communication abilities to work effectively with various stakeholders. While based in Germany with hybrid work options, some travel is required for conferences and partner visits.

Join NVIDIA to be part of a team that's driving innovation in AI computing and helping shape the future of technology. The company offers a collaborative environment where creativity and autonomous problem-solving are valued, making it one of the most desirable employers in the technology sector.

Last updated 7 days ago

Responsibilities For Senior Developer Technology Engineer - Windows LLM & GenAI Open-Source Ecosystem

  • Improve Windows LLM & GenAI user experience on NVIDIA RTX
  • Engage with internal product teams and external OSS maintainers
  • Work on solving local end-to-end LLM & Generative AI GPU deployment challenges
  • Apply profiling and debugging tools for analyzing GPU-accelerated AI applications
  • Conduct hands-on trainings and develop sample code
  • Guide developers in efficient adoption of DL frameworks
  • Collaborate with GPU driver and architecture teams

Requirements For Senior Developer Technology Engineer - Windows LLM & GenAI Open-Source Ecosystem

Python
Linux
  • BS or MS degree in Computer Science, Engineering, or related degree
  • 5+ years of professional experience in local GPU deployment, profiling and optimization
  • Strong proficiency in C/C++, Python, software design, programming techniques
  • Familiarity with and development experience on the Windows operating system
  • Theoretical understanding of Transformer architectures - specifically LLMs and Generative AI
  • Experience working with open-source LLM and GenAI software
  • Experience with CUDA and NVIDIA's Nsight GPU profiling and debugging suite
  • Strong verbal and written communication skills in English
  • Excellent interpersonal skills
  • Willing to travel for conferences and partner visits

Related Jobs