Data Engineer

MediaLab is a media & technology company focused on acquiring and growing properties and global brands. The organization is a unique combination of private equity, holding company and operating entity. They continue to expand and are proud of the prominent market position of their brands.

As a Data Engineer at MediaLab, you will be a key member of the team that builds and maintains data platform solutions. The Data team works with all of MediaLab brands (Genius, Imgur, Kik, Worldstar Hip-Hop, Amino, Whisper) as well as business teams across the organization. They own a streaming pipeline which handles thousands of events per second and billions per day; a BigQuery instance comprising dozens of schemas, thousands of tables, and over a petabyte of storage; and hundreds of DAGs in Airflow and Dataform.

Your responsibilities will include:

• Maintaining and optimizing go-based pub/sub consumers handling complex transformation logic
• Improving the efficiency of multiple repositories dedicated to ingesting and parsing data from a wide variety of sources
• Helping improve monitoring efforts and troubleshooting problems with ETL jobs and event pipelines
• Supporting requests from business teams to find and ingest new data sources
• Working with engineering teams on all brands to integrate their application data to the data warehouse/data lake
• Contributing to setting up and adjusting deployment workflows

The ideal candidate should have:

• 1-2 years of professional experience as a data engineer or software engineer with significant exposure to working with data
• Comfort with Python, with Golang experience being a big plus
• Experience with at least one major cloud provider (GCP and/or AWS preferred)
• Experience using containers; Kubernetes experience is preferred
• Very solid SQL skills and understanding of efficient complex queries
• Ability to write clear documentation
• Experience with CI/CD platforms, Terraform or infrastructure as code
• Experience with major data warehouses and pub/sub tools is a plus

Join an exceptionally talented team of engineers, designers, product and business builders in a company that values diversity and inclusivity.