Taro Logo

Senior Platform Data Engineer Interview Experience - Amsterdam, Netherlands

October 1, 2022
Negative ExperienceNo Offer

Process

I applied online on the Flow Traders website.

  1. Call from the recruiter
  2. Take-home assignment consists of two parts: a. System design: Design a system to get data from trading systems and make it available for historical analysis. The trading systems provide data in two ways: gRPC and a dump file every minute. b. PySpark code: Given this input, write code to generate the output by joining two dataframes.
  3. Technical interview to discuss the assignment: Mainly focused on my CV and previous experience, and a little bit about the system design solution. The team lead, who was supposed to be in this interview, was on vacation.
  4. Round 2 technical interview: With the team lead and a data engineer, more focused on software engineering and how programming languages work, as they need a very strong data engineer with extended knowledge and experience in data engineering and platform engineering.

All but the last part was OK. I got a rejection a few days later.

Questions

How does Python store data in memory?

How does multithreading work in Python? When you submit a function to the pool, does it start a thread for each function?

How does the programming language handle allocated memory that doesn't have a reference? How does that work?

How does windowing work in Spark?

What type of join do you use to join a big dataset with a small dataset in Spark?

How do we increase topic parallelism in Kafka?

How to handle scaling up and down in Kafka? How to handle decreasing the number of partitions in each topic?

How did you deploy the Spark operator on Kubernetes in your previous job?

How do you prevent duplications/overwriting final data in a Lambda architecture in case the streaming path was down for a while and then got fixed?

Was this helpful?

Interview Statistics

The following metrics were computed from 1 interview experience for the Flow Traders Senior Platform Data Engineer role in Amsterdam, Netherlands.

Success Rate

0%
Pass Rate

Flow Traders's interview process for their Senior Platform Data Engineer roles in Amsterdam, Netherlands is extremely selective, failing the vast majority of engineers.

Experience Rating

Positive0%
Neutral0%
Negative100%

Candidates reported having very negative feelings for Flow Traders's Senior Platform Data Engineer interview process in Amsterdam, Netherlands.

Flow Traders Work Experiences