Taro Logo

Senior Data Engineer, Machine Learning

Metropolis is an artificial intelligence company that uses computer vision technology to enable frictionless, checkout-free experiences in the real world.
$140,000 - $165,000
Data
Senior Software Engineer
Hybrid
51 - 100 Employees
5+ years of experience
This job posting is no longer active. 😔

Job Description

Metropolis is seeking a Senior Data Engineer, Machine Learning to play a crucial role in architecting, implementing, and managing our ML data ecosystem to support advanced machine learning initiatives. You will be a thoughtful hands-on leader who operates based on principles and establishes best practices. While you are expected to be adept at making technical decisions, your responsibility is beyond just implementation – you will be influencing strategic decisions, mentoring engineers around you, and elevating the team through examples.

Responsibilities:

  • Design, build, and maintain robust, scalable data pipelines that support ML model development and deployment.
  • Ensure efficient data storage, retrieval, and management practices that support real-time and batch processing needs.
  • Work closely with ML engineers and data scientists to understand their data requirements and implement solutions that enable effective ML model training and evaluation.
  • Develop and enforce policies for data quality, security, and compliance, ensuring integrity.
  • Monitor and optimize the performance of data pipelines and key metrics to ensure efficient operation in production environments.
  • Stay ahead of emerging technologies and methodologies in data engineering and machine learning.
  • Mentor junior team members and elevate the team through knowledge sharing.

Metropolis is reimagining parking to enable millions of consumers to just "drive in and drive out." We envision a future where people transact in the real world with a speed, ease and convenience that is unparalleled, even online. Tomorrow, we will power checkout-free experiences anywhere you go to make the everyday experiences of living, working and playing remarkable - giving us back our most valuable asset, time.

When you join Metropolis, you'll join a team of world-class product leaders and engineers, building an ecosystem of technologies at the intersection of parking, mobility, and real estate. Our goal is to build an inclusive culture where everyone has a voice and the best idea wins. You will play a key role in building and maintaining this culture as our organization grows.

Last updated a year ago

Responsibilities For Senior Data Engineer, Machine Learning

  • Design, build, and maintain robust, scalable data pipelines that support ML model development and deployment
  • Ensure efficient data storage, retrieval, and management practices that support real-time and batch processing needs
  • Work closely with ML engineers and data scientists to understand their data requirements and implement solutions that enable effective ML model training and evaluation
  • Develop and enforce policies for data quality, security, and compliance, ensuring integrity
  • Monitor and optimize the performance of data pipelines and key metrics to ensure efficient operation in production environments
  • Stay ahead of emerging technologies and methodologies in data engineering and machine learning
  • Mentor junior team members and elevate the team through knowledge sharing

Requirements For Senior Data Engineer, Machine Learning

Python
Scala
  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field
  • Minimum of 5 years of experience in a Data Engineering role, with at least 2 years focused on ML data engineering
  • Proven experience in designing and implementing large-scale data pipelines and architectures
  • Strong programming skills in Python or Scala and proficiency with SQL
  • Experience building batch and streaming ingestion data pipelines for structured and unstructured data (text, images)
  • Experience with data warehousing solutions (Snowflake, Databricks), feature stores, ETL tools (Airflow, Mage AI, DBT etc), and data modeling practices
  • Experience with big data technologies (e.g., Hadoop, Spark) and cloud services (e.g., AWS, Azure, Google Cloud Platform)
  • Excellent problem-solving, analytical, and communication skills

Benefits For Senior Data Engineer, Machine Learning

Medical Insurance
401k
Equity
  • Healthcare benefits
  • 401(k) plan
  • Stock option plan
  • Bonus plans