Senior Data Engineer, Mapping

At Lyft, our mission is to improve people's lives with the world's best transportation. We're hiring a Senior Data Engineer to help us make data-driven decisions in our Mapping team. As a Data Engineer at Lyft, you'll develop robust data infrastructure for data transport, collection, and storage, enabling leadership to make informed decisions.

You'll build a scalable data platform, propose new ideas, evaluate approaches, and communicate technical problems. You'll own the core data pipeline powering mapping's top-line metrics and help evolve data models across the data stack. Your work will support Lyft's growing data processing and analytics needs, providing insights into business and user behavior.

Our tech stack includes AWS, Kubernetes, and Apache Airflow. You'll work with passionate colleagues from software engineering, machine learning, and data science on projects impacting millions of passengers and drivers.

Responsibilities:

• Own core data pipelines in mapping, scaling data processing to meet Lyft's rapid growth
• Evolve data models and schemas based on business and engineering needs
• Implement data quality and consistency tracking systems
• Develop tools for self-service data pipeline management (ETL)
• Tune SQL and MapReduce jobs for better performance
• Write well-crafted, tested, readable, and maintainable code
• Participate in code reviews and on-call rotations
• Collaborate with internal and external partners

Requirements:

• Bachelor's degree in Computer Science, Engineering, Mathematics, Statistics, or related field
• 4+ years of relevant professional experience
• Strong experience with Spark
• Experience with Hadoop ecosystem, S3, DynamoDB, MapReduce, Yarn, HDFS, Hive, Presto, Pig, HBase, Parquet
• Strong skills in scripting languages (Python, Ruby, Bash)
• Advanced SQL performance tuning skills
• Proficiency in at least one SQL language (MySQL, PostgreSQL, SqlServer, Oracle)
• Experience with workflow management tools (Airflow, Oozie, Azkaban, UC4)
• Ability to work directly with data analytics team

Join Lyft and be part of a diverse, inclusive team working on cutting-edge transportation solutions!