Taro Logo

On-device ML Engineer - US Remote

Hugging Face is a leading AI organization advancing good Machine Learning and making it more accessible, with the fastest-growing, open-source library of pre-trained models in the world.
$120,000 - $200,000
Machine Learning
Senior Software Engineer
Remote
501 - 1,000 Employees
5+ years of experience
This job posting may no longer be active. You may be interested in these related jobs instead:

Description For On-device ML Engineer - US Remote

Here at Hugging Face, we're on a journey to advance good Machine Learning and make it more accessible. As an On-device ML Engineer, you will explore cutting-edge methods to run models on consumer platforms, with a special focus on Apple technologies. Your responsibilities will include optimizing, quantizing, and converting the best models for efficient execution on iPhones and Macs. You'll design, build, and contribute to open source software that demonstrates model usage and develop libraries to minimize friction for developers who may not be deeply familiar with ML.

Key responsibilities include:

  • Model evaluation and optimization for Apple platforms
  • Converting SOTA models to native formats like Core ML or MLX
  • Writing Swift code for ML tasks and optimizations
  • Contributing to open source projects
  • Creating tools for easy model conversion and sharing

We're looking for someone with:

  • Strong Swift development background
  • Deep understanding of ML model architectures
  • Experience with Core ML and various ML frameworks
  • Passion for open-source contributions
  • Ability to work across different levels of abstraction
  • Strong optimization and debugging skills

Hugging Face offers a supportive work environment with benefits including:

  • Health, dental, and vision coverage
  • Flexible working hours and remote options
  • Parental leave and flexible PTO
  • Reimbursement for relevant conferences and training
  • Company equity as part of compensation

Join us in building the future of machine learning and artificial intelligence in a diverse, equitable, and inclusive workplace. We value continuous growth and development, and we're excited to see how you can contribute to our mission of making ML more accessible.

Last updated 10 months ago

Responsibilities For On-device ML Engineer - US Remote

  • Optimize, quantize, and convert models for efficient execution on iPhones and Macs
  • Design, build, and contribute to open source software demonstrating model usage
  • Develop libraries to minimize friction for developers
  • Evaluate models considering quality, latency, memory, and storage needs
  • Convert SOTA models to native formats like Core ML or MLX
  • Optimize model architectures for Apple Silicon platforms
  • Write Swift code to implement or optimize ML tasks
  • Produce high-quality technical documentation
  • Contribute to open source projects
  • Create tools for easy model conversion, running, and sharing
  • Occasionally write or understand low-level code such as parallel GPU kernels

Requirements For On-device ML Engineer - US Remote

Python
Kotlin
TypeScript
  • Strong background in Swift development
  • Deep understanding of essential model architectures
  • Passion for machine learning
  • Experience with Core ML
  • Eagerness to publish and contribute to open-source libraries
  • Ability to move across different levels of abstraction
  • Understanding of various optimization techniques
  • Strong systems understanding
  • Experience with frameworks such as llama.cpp, MLX, PyTorch, and CoreNet
  • Good debugging skills
  • Excellent technical documentation writing skills
  • Engagement in discussion forums and communities

Benefits For On-device ML Engineer - US Remote

Equity
Medical Insurance
Dental Insurance
Vision Insurance
Parental Leave
  • Health, dental, and vision benefits for employees and their dependents
  • Parental leave
  • Flexible paid time off
  • Reimbursement for relevant conferences, training, and education
  • Company equity as part of compensation package
  • Flexible working hours
  • Remote work options

Interested in this job?