Taro Logo

Databricks Developer (with Python)

Data
Hybrid
Enterprise SaaS

Job Description

Tek Spikes is seeking a skilled Databricks Developer with Python expertise for a hybrid position in Dallas, Texas. This role focuses on building and maintaining data infrastructure using Azure Databricks and various database technologies. The ideal candidate will have strong ETL experience with RDBMSs and NoSQL databases, particularly MongoDB, along with proficiency in Python, PySpark, and Scala.

The position involves designing and implementing scalable data processing solutions, working closely with data scientists and analysts to meet data requirements, and ensuring optimal performance of data pipelines. You'll be responsible for maintaining data quality throughout transformation processes, developing architecture standards, and implementing monitoring systems for data integrity.

This is an excellent opportunity for a data engineer who enjoys working with modern data technologies and wants to make an impact in a dynamic environment. The hybrid work arrangement offers flexibility while maintaining collaborative opportunities with the team. The role requires a blend of technical expertise in data engineering and soft skills for effective cross-functional collaboration.

The position demands strong problem-solving abilities, as you'll be responsible for troubleshooting complex data-related issues and optimizing system performance. Your work will be crucial in maintaining robust data infrastructure and ensuring smooth data operations across the organization.

Last updated 2 months ago

Responsibilities For Databricks Developer (with Python)

  • Design and implement scalable data processing solutions using Azure Databricks
  • Collaborate with data scientists and data analysts to understand data needs
  • Optimize data pipelines and workflows for performance and scalability
  • Ensure data quality and integrity throughout data transformation and load processes
  • Develop and maintain data architecture and best practices
  • Troubleshoot and resolve data-related issues in a timely manner
  • Set up performance monitoring and alerting for pipeline and data integrity

Requirements For Databricks Developer (with Python)

Python
MongoDB
  • Proficiency in ETL between different RDBMSs (e.g., Oracle) to Databricks and NoSQL databases
  • Experience working with Mongo DB
  • Working knowledge in Python, PySpark, and Scala

Related Jobs