Data Engineer - Spark
Description For Data Engineer - Spark
Lowe's, a Fortune 50 home improvement retailer with over 1,700 stores nationwide, is seeking a Data Engineer to join their team in Charlotte. This role sits at the intersection of big data and business analytics, requiring expertise in technologies like Spark, Hadoop, and various data processing tools.
The position offers an exciting opportunity to work on enterprise-scale data solutions that directly impact millions of customer transactions weekly. As a Data Engineer, you'll be responsible for developing and maintaining data pipelines, implementing business metrics, and creating analytical solutions that drive business insights.
The ideal candidate should have a strong foundation in programming (Java/Scala/Python) and data technologies (SQL, Hadoop, Spark). You'll work in a collaborative environment, participating in code reviews, following CI/CD practices, and ensuring high-quality deliverables through comprehensive testing.
What makes this role particularly appealing is Lowe's commitment to both technical excellence and employee well-being. The company offers competitive compensation, comprehensive benefits, and a strong focus on work-life balance. With opportunities to work on cutting-edge data technologies while solving real business challenges, this position provides an excellent path for career growth in data engineering.
The role combines technical challenges with business impact, offering the chance to work with modern data technologies while contributing to a company that has been serving communities since 1921. Lowe's culture emphasizes innovation and continuous improvement, making it an ideal environment for data professionals looking to make a significant impact.
Responsibilities For Data Engineer - Spark
- Develop integrated business and enterprise application solutions in data analytical space
- Develop software/data solutions using programming fundamentals
- Ensure good unit testing and functional testing coverage
- Follow best source control and CI/CD practices
- Review technical documents, design, code and perform peer reviews
- Develop and participate in group design for data pipelines
- Implement business metrics using SQL
- Implement transformation logic to aggregate and combine datasets
- Analyze and organize data to determine required datasets
- Develop and maintain operational and analytical applications
- Troubleshoot system issues and perform root cause analysis
Requirements For Data Engineer - Spark
- Bachelor's Degree in Engineering, Computer Science, CIS, or related field
- 2 years of experience in Data, BI or Platform Engineering
- 1 year of experience working on projects with SDLC
- Experience with Hadoop or Cloud Bigdata components
- Expertise in Java/Scala/Python, SQL, Scripting
- Experience with Teradata, Hadoop (Sqoop, Hive, Pig, Map Reduce)
- Experience with Spark (Spark Streaming, MLib), Kafka
Benefits For Data Engineer - Spark
- Comprehensive medical, dental and vision insurance
- 401(k) retirement account with company match up to 4.25%
- 10 weeks paid maternity leave and 4 weeks paid parental leave
- Paid time off for vacation, holidays, sick leave and volunteer time
- Employee Stock Purchase Plan (ESPP) with 15% discount
- Dependent care resources and adoption assistance
- Mental health care and Employee Assistance Programs
