I was contacted by the Hiring Manager via LinkedIn. I had a telephonic call with the Hiring Manager, which was a general discussion about the role, work routine, and high-level expectations. They are looking for highly technical talent with great communication skills who can represent DataBricks at the client's end. You basically work virtually and visit client locations with approximately 30% travel per month. Following this, there were general questions about my work experience and past projects.

At the end, the Hiring Manager asked a couple of technical questions, including some on Spark architecture, to ensure the candidate had potential for the next round.

Next, HR contacted me for a take-home assignment. It was a pretty exhaustive assignment, covering everything from data transformation to ML. I completed the assignment in two days and was confident in my solution, but surprisingly, I didn't pass.

After requesting a feedback call, I learned that the output was good enough; however, my write-up and communication of the solution were not up to their expectations. I had also made spelling mistakes. They did not find it suitable, as this role requires representing DataBricks.

Emphasis should be placed on your presentation and solution communication aspects, not just the technical aspects. Good luck.

Spark Cluster Architecture

Everything on Spark, from simple data transformation to ML.