Senior Data Engineer (IR-454)
Job Description
Intellectsoft, a leading software development company since 2007, is seeking a Senior Data Engineer to join their team. The role focuses on an AI-powered platform that helps businesses make better decisions through advanced analytics and machine learning. The platform analyzes large amounts of data to provide insights and predictions, particularly in healthcare and other industries.
The ideal candidate will have 5+ years of professional experience with strong expertise in data engineering using Apache Spark and SQL. You'll be responsible for designing and building scalable data pipelines, collaborating with data science teams, and creating standardized data models. The role requires proficiency in Python, PySpark, and experience with ETL pipelines and distributed computing.
Working remotely, you'll join a company that partners with major clients like Jaguar Motors, Universal Pictures, and Harley-Davidson. The position offers excellent benefits including 35 days of annual leave, professional development through Udemy courses, English language training, and regular team activities.
This is an opportunity to work on cutting-edge AI and data solutions while being part of a global team that delivers innovative solutions across multiple industries. The role combines technical expertise with business impact, making it ideal for a senior data engineer looking to work on meaningful projects with significant scale and complexity.
The company provides a strong focus on professional growth with regular training opportunities and a collaborative environment. You'll be working with modern technologies and best practices in software development, while maintaining a healthy work-life balance through generous time off and flexible remote work arrangements.
Responsibilities For Senior Data Engineer (IR-454)
- Design and build highly reliable and scalable data pipelines using PySpark and big data technologies
- Collaborate with the data science team to develop new features that enhance model accuracy and performance
- Create standardized data models to improve consistency across various deployments
- Troubleshoot and resolve issues in existing ETL pipelines and optimize workflows
- Conduct POCs to evaluate new technologies and integrate additional data sources
- Follow and promote best practices for software development, ensuring high-quality solutions that meet requirements and deadlines
- Document development updates and maintain clear technical documentation
Requirements For Senior Data Engineer (IR-454)
- 5+ years of professional experience, including 2+ years of data engineering with Apache Spark and SQL
- Proficiency in Python for data processing and automation
- Knowledge of PySpark, distributed computing, analytical databases and other big data technologies
- Expertise in designing and managing ETL pipelines and distributed data processing frameworks
- Strong knowledge of database systems, data modeling, and analytical databases
- Hands-on experience with workflow orchestration tools such as Apache Airflow
- Familiarity with cloud platforms like AWS, GCP, or Azure
- Solid understanding of software development lifecycles, including coding standards, version control, and testing
- Bachelor's or master's degree in Computer Science or a related field (Nice to have)
- Familiarity with the data science and machine learning development process (Nice to have)
- Understanding of Machine Learning pipelines or frameworks (Nice to have)
Benefits For Senior Data Engineer (IR-454)
- 35 absence days per year for work-life balance
- Udemy courses of your choice
- English courses with native-speaker
- Regular soft-skills trainings
- Excellence Centers meetups
- Online/offline team-buildings
Related Jobs
