Data Engineer - Spark
Description For Data Engineer - Spark
Lowe's, a Fortune 50 home improvement retailer with over 1,700 stores and 16 million weekly customers, is seeking a Data Engineer to join their team in Charlotte. This role focuses on developing and implementing data solutions that drive business insights and operational efficiency.
The position requires expertise in big data technologies including Hadoop, Spark, and Kafka, along with strong programming skills in Python/Java/Scala and SQL. You'll be responsible for building data pipelines that connect various systems - from operational to streaming to big data platforms - while ensuring high quality through comprehensive testing and best practices in source control and CI/CD.
As a Data Engineer, you'll work on implementing business metrics, transforming and aggregating datasets, and maintaining analytical applications that provide essential insights. The role offers opportunities to work with cutting-edge data technologies while solving complex problems that impact millions of customers.
The company provides comprehensive benefits including healthcare, 401(k) with company match, stock purchase plans, and generous parental leave. You'll be part of a team that values continuous learning and innovation, with access to modern data infrastructure and tools.
This is an ideal opportunity for a data professional with 2+ years of experience who wants to work on large-scale data challenges while contributing to a company that has been serving communities for over 100 years. You'll help shape how data is used to improve the home improvement retail experience while working alongside talented engineers and data professionals.
Responsibilities For Data Engineer - Spark
- Develop integrated business and enterprise application solutions in data analytical space
- Develop software/data solutions using programming fundamentals
- Ensure good unit testing and functional testing coverage
- Follow best source control and CI/CD practices
- Review technical documents, design, code and perform peer reviews
- Develop data pipelines between different systems (operational, transactional, streaming, big data)
- Implement business metrics using SQL
- Implement transformation logic to aggregate and combine datasets
- Analyze and organize data to determine required datasets and metrics
- Develop and maintain operational and analytical applications
- Troubleshoot system issues and perform root cause analysis
Requirements For Data Engineer - Spark
- Bachelor's Degree in Engineering, Computer Science, CIS or related field
- 2 years of experience in Data, BI or Platform Engineering
- 1 year experience with SDLC implementation
- Experience with Java/Scala/Python, SQL, Scripting
- Experience with Teradata, Hadoop (Sqoop, Hive, Pig, Map Reduce)
- Experience with Spark (Spark Streaming, MLib), Kafka
- Knowledge of source control and CI/CD practices
- Experience with testing and deployment
Benefits For Data Engineer - Spark
- Paid time off for vacation, holidays, sick leave, and volunteer time
- 401(k) retirement account with company match up to 4.25%
- Comprehensive medical, dental and vision insurance
- 10 weeks paid maternity leave and 4 weeks paid parental leave
- Employee Stock Purchase Plan (ESPP) with 15% discount
- Mental health care and Employee Assistance Programs
Jobs Related To Lowe's Data Engineer - Spark
