Applied via LinkedIn.

Received an online assessment invite after 2 days.

1. OA Round: There was one lengthy Spark Scala question and multiple MCQs.

2. Design Round: Q: You are given three data sources (CSV files, clickstream, APIs). Build a data pipeline to serve the data to the data science team for analysis.

3. HM Round: Started with project discussions. Discussed how I would fit into their team/work. Discussion on Spark, including internals and operations. Medium-level SQL queries were asked.

4. Spark Round: Started with a lengthy Spark question involving two files, filter conditions, and operations like joins and selects. Then proceeded to write a few medium to complex SQL queries.

5. Solution Engg Round: Q: Design solution discussion on my recent project at work, covering the end-to-end flow. Python questions were asked (basic flatten JSON, count of letters, easy to medium level). SQL queries were asked.

Spark internals and operations/transformations along with optimization.

CASE WHEN, RANK, LEAD/LAG based advanced SQL queries.

Flatten a nested JSON in Python.

Display only the letters occurring more than once in a string in Python.