Taro Logo

Data Engineer

A company providing intelligence and insights for commodities, energy, and maritime sectors through data analysis since 2014.
Bogotá, Bogota, Colombia
Data
Mid-Level Software Engineer
Remote
501 - 1,000 Employees
Enterprise SaaS · Logistics

Description For Data Engineer

Kpler, established in 2014, is a leading provider of intelligence and insights for the commodities, energy, and maritime sectors. With a team of over 600 experts from 35+ countries, they transform complex data into actionable strategies through user-friendly platforms. The Data Engineer role is part of the Commodities Market Data team, responsible for handling critical data from thousands of maritime trade sources. The position involves developing and maintaining data pipelines, ensuring data quality, and implementing backend systems. The ideal candidate should be proficient in Python, ETL processes, and various modern data technologies. The role offers the opportunity to work remotely while contributing to a global team that helps organizations navigate complex markets. Kpler emphasizes an inclusive work environment and welcomes diverse perspectives, making it an excellent opportunity for those passionate about data engineering in the commodities sector.

Last updated 15 days ago

Responsibilities For Data Engineer

  • Development and implementation of core data ingestion and distribution pipelines
  • Implementation of back-end systems based on project requirements
  • Troubleshoot and optimize existing workflows
  • Ensure data integrity and accuracy across various pipelines

Requirements For Data Engineer

Python
Kubernetes
  • Proficient in Python, with experience in data manipulation and Pandas
  • Knowledge of data integration, ETL processes, and batch/streaming data processing
  • Understanding of containerisation and orchestration tools (Docker, Kubernetes, Airflow)
  • Familiar with SQL, RDBMS or Big Data technologies
  • Experience with Git, code reviews, and Agile methodologies
  • Experience with AWS and Terraform (Nice to have)

Interested in this job?

Jobs Related To Kpler Data Engineer