Sr. Data Engineer
Description For Sr. Data Engineer
TRADER Corporation, a Canadian leader in online media and automotive services, is seeking a Sr. Data Engineer to join their team. This role is centered around core data systems including Data Warehouse, Data Lake, and BI. The successful candidate will be responsible for coding, reviewing, and accepting Data Movement and Data Integration code for production. They will be involved in projects from inception through design, development, and post-production support, ensuring high-quality deliverables. The role combines design, development, and operations responsibilities, utilizing a full suite of integration tools and technologies while adhering to configuration management and security best practices.
Key responsibilities include:
- Developing and maintaining scalable data pipelines
- Collaborating with analytics and business teams to improve data models
- Implementing data quality monitoring processes
- Writing unit/integration tests and documenting work
- Performing data analysis to troubleshoot issues
- Working closely with cross-functional teams
- Defining company data assets and designing data integrations
The ideal candidate will have:
- 10+ years of IT experience in large-scale technology architecture
- 3+ years of experience with cloud technology stacks (AWS, Azure, GCP)
- Expertise in data integration/ETL tools like Databricks or DataStage
- Proficiency in SQL, Scala, Python, Spark, and Kafka
- Experience with distributed and highly scalable applications
- Strong background in software development and architecture
TRADER Corporation offers a comprehensive benefits package, including:
- Fitness and wellness programs
- Employee and Family Assistance Program
- Competitive salary with annual bonus structure
- 3% CPP matching for financial planning
- Training and development opportunities
Join TRADER Corporation to be part of a dynamic team driving innovation in the automotive industry while enjoying a supportive work environment that values work-life balance.
Responsibilities For Sr. Data Engineer
- Develop and maintain scalable data pipelines
- Collaborate with analytics and business teams to improve data models
- Implement processes to monitor data quality
- Write unit/integration tests and document work
- Perform data analysis to troubleshoot issues
- Work closely with cross-functional teams
- Define company data assets and documentation
- Design data integrations and data quality framework
- Evaluate tools for data lineage
- Develop strategy for long term data platform architecture
Requirements For Sr. Data Engineer
- University Degree or College Equivalent
- 10+ years IT experience in large scale technology architecture
- 3+ years developing and supporting applications leveraging Cloud technology stack (AWS, Azure, GCP)
- 3+ years experience with data integration/ETL tools
- SDLC knowledge in waterfall and agile methodologies
- Experience with source code management and continuous integration tools
- Proficiency in SQL, Scala, Python, Spark, Kafka
- Experience with distributed and highly scalable applications
- Experience with Cloud based environments (Azure, GCP preferred)
- Experience with high-volume, transaction processing software applications
- Understanding of workload management and distributed platform architectures
- Experience in Java EE technologies
- Experience in scripting languages & automation
- Experience in data warehousing, analytics, and business intelligence
- 5+ years hands-on experience on Linux, AIX, and z/OS
Benefits For Sr. Data Engineer
- Gym discounts
- On-site gyms
- Employee and Family Assistance Program
- Virtual wellness program
- Conferences & training budget
- Regular internal training programs
- 3% CPP matching
- Annual bonus structure
