Data Engineer
Job Description
Lucidya is seeking a Data Engineer to play a crucial role in building and maintaining their data infrastructure. The position involves designing, developing, and managing scalable data pipelines that support analytics and machine learning teams. The ideal candidate will have strong expertise in data modeling, ETL processes, and database technologies. This role offers the opportunity to shape the infrastructure and technical future of Lucidya, working with cutting-edge technologies and contributing to the company's growth. The position combines technical challenges with collaborative teamwork, offering both ESOP and performance-based bonuses. The role requires 3+ years of experience and strong programming skills in Python, Java, or Scala, along with expertise in database technologies and ETL processes.
Responsibilities For Data Engineer
- Designing and implementing ETL processes to move and transform data from various sources
- Building and maintaining the data infrastructure necessary for data storage, processing, and analysis
- Collaborating with data analysts and data scientists to understand their data needs and provide relevant support
- Ensuring data quality and integrity throughout the data lifecycle
- Optimizing data storage and retrieval processes for performance and scalability
- Documenting data flows, transformations, and any changes to data architecture
Requirements For Data Engineer
- Bachelor's degree in Computer Science, Information Technology, or a related field
- 3+ years of experience in a Data Engineer or similar role
- Strong knowledge of SQL and experience with database technologies (e.g., PostgreSQL, MySQL)
- Proficient in programming languages such as Python, Java, or Scala
- Experience with ETL tools and frameworks (e.g., Apache Airflow, Talend, or similar)
- Familiarity with cloud platforms (e.g., AWS, Google Cloud Platform, Azure) and their data services
- Knowledge of big data technologies (e.g., Hadoop, Spark) is a plus
- Strong attention to detail and ability to ensure data accuracy and consistency
- Excellent communication skills and ability to work collaboratively with cross-functional teams
Benefits For Data Engineer
- Employee Stock Option Plans (ESOP)
- Performance-based bonuses
Related Jobs
