Lead Data Engineer
Description For Lead Data Engineer
Two Circles is a leading sports and entertainment analytics company that helps organizations understand and grow their fan base through data-driven insights. They're seeking a Lead Data Engineer for a 6-month contract position to join their team working on the KORE Intelligence Platform - a sophisticated fan and partnership intelligence solution that integrates with over 150 providers.
The role requires an experienced engineer to design and operate enterprise-scale data architectures in AWS, working with technologies like Spark, Kinesis, Airflow, and Terraform. You'll be responsible for building secure, highly available, and cost-optimized pipelines that handle both batch and streaming workloads. The position offers an opportunity to shape the future of their SaaS-based fan intelligence platform while working with cutting-edge cloud technologies.
The ideal candidate will bring 3+ years of data engineering experience, strong AWS expertise, and a proven track record of managing sensitive data architectures. You'll need to be proficient in Python and either Scala or C#, with experience in containerization, infrastructure as code, and modern observability practices. The role combines technical leadership with hands-on development, requiring both strong engineering skills and the ability to mentor team members.
Working in a hybrid environment in Vancouver, you'll collaborate with cross-functional teams including Product, DevOps, BI, and Client Services. The position offers exposure to high-profile clients in the sports and entertainment industry while working on challenging technical problems at scale. This is an excellent opportunity for a senior data engineer looking to make an impact in a dynamic, fast-paced environment while working with modern data technologies and architectures.
Responsibilities For Lead Data Engineer
- Lead the design and implementation of scalable, secure, and fault-tolerant data pipelines
- Champion enterprise data governance, monitoring, and alerting practices
- Collaborate with cross-functional teams to drive end-to-end delivery of data features
- Take ownership of pipeline performance, observability, cost efficiency, and CI/CD workflows
- Provide technical guidance and mentor junior team members
- Contribute to platform reliability and scalability
Requirements For Lead Data Engineer
- 3+ years of professional experience as a Data Engineer in cloud environments
- Strong experience with AWS services: S3, Lambda, Kinesis, DynamoDB, Redshift, EC2, EMR, IAM
- Experience with secure data architectures and regulated data
- Expertise in big data architectures, Data Lakes and Lake houses
- Experience with real-time data streaming using AWS Kinesis
- Strong programming experience in Python and Scala or C#
- Experience with Apache Airflow for job scheduling
- Proficient with Docker and orchestration with ECS or Kubernetes
- Experience with infrastructure as code (Terraform, CloudFormation)
- Experience with observability tools like New Relic, CloudWatch, Prometheus, or Datadog
- Excellent written and verbal communication skills
Jobs Related To Two Circles Lead Data Engineer
