Taro Logo

Perception Engineer

AI research and deployment company dedicated to ensuring general-purpose artificial intelligence benefits all of humanity
$325,000 - $405,000
Machine Learning
Senior Software Engineer
Hybrid
1,000 - 5,000 Employees
5+ years of experience
AI · Robotics

Job Description

OpenAI is seeking a Perception Engineer to join their Consumer Products department, focusing on building core vision and sensor fusion capabilities for hardware systems. This role combines computer vision, robotics, and systems engineering, requiring expertise in real-time perception systems for closed-loop control. The position offers a competitive salary range of $325K-$405K plus equity and comprehensive benefits.

The role involves developing state-of-the-art perception systems, implementing robust sensor integration, and optimizing performance on constrained hardware. You'll work with cutting-edge technology in computer vision and machine learning, while collaborating with cross-functional teams to deliver reliable solutions in real-world applications.

The ideal candidate should have extensive experience in real-time perception systems, strong programming skills in C++ and Python, and deep understanding of computer vision fundamentals. The position requires working from the San Francisco office 4 days per week, with relocation assistance available.

OpenAI offers an exceptional benefits package including comprehensive healthcare, flexible PTO, 401(k) matching, parental leave, and various other perks. The company's mission focuses on ensuring AI benefits humanity, making this an opportunity to work on cutting-edge technology while contributing to a meaningful cause.

This role is perfect for someone who enjoys the challenge of building robust perception systems and wants to work at the forefront of AI technology. The position combines technical depth with practical implementation, requiring both theoretical knowledge and hands-on engineering skills.

Last updated 2 days ago

Responsibilities For Perception Engineer

  • Design and implement perception pipelines for detection, tracking, segmentation, depth/optical flow, and scene understanding
  • Build robust sensor ingest systems including camera capture, IMU/time sync, buffering, and zero-copy data paths
  • Calibrate and fuse multimodal sensors and implement state estimation
  • Optimize on-device inference and vision kernels across CPU/GPU/NPU/ISP
  • Define clean interfaces to planning/control teams
  • Instrument performance and reliability through profiling and testing
  • Collaborate cross-functionally with camera, systems, and controls engineers

Requirements For Perception Engineer

Python
  • Deep experience building and shipping real-time perception for robots, mobile platforms, or edge devices
  • Fluent in C++ and Python
  • Strong foundations in 3D geometry, camera models, probabilistic estimation, and computer vision/ML fundamentals
  • Hands-on expertise with camera pipelines, sensor fusion, and calibration/time synchronization
  • Skilled in deploying and optimizing ML models on resource-constrained devices
  • Knowledge of system profiling and tuning for latency, memory, and power efficiency

Benefits For Perception Engineer

Medical Insurance
Dental Insurance
Vision Insurance
401k
Parental Leave
Mental Health Assistance
Education Budget
Relocation Benefits
Commuter Benefits
  • Medical, dental, and vision insurance for family
  • Health Savings Accounts
  • Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses
  • 401(k) retirement plan with employer match
  • Paid parental leave up to 24 weeks
  • Flexible PTO
  • 13+ paid company holidays
  • Mental health and wellness support
  • Employer-paid basic life and disability coverage
  • Annual learning and development stipend
  • Daily meals in offices and meal delivery credits
  • Relocation support
  • Charitable donation matching
  • Wellness stipends

Related Jobs

Research Engineer / Research Scientist - ChatGPT Agent

Senior AI research position at OpenAI focusing on developing and implementing advanced AI agents through ChatGPT, offering $295K-$530K plus equity and comprehensive benefits.

Sr. Software Engineer – Generative AI & Assistants, ArcGIS Pro

Senior Software Engineer position focused on implementing AI and machine learning capabilities in ArcGIS Pro, Esri's leading GIS software.

Software Engineer, Perception Scenarios

Senior Software Engineer position at Aurora focusing on perception scenarios and backend systems for autonomous vehicle technology.

Senior Software Engineer

Senior Software Engineer role at Microsoft working on AI Frameworks team to optimize LLM performance and develop AI infrastructure.

Senior Deep Learning Software Engineer, Inference

Senior Deep Learning Software Engineer position at NVIDIA focusing on optimizing AI inference frameworks and GPU-accelerated software for large-scale model serving.