I applied online through their portal and received an email from the Hiring Manager for an initial screening. The screening went well, covering data warehousing and Big Data concepts.

I cleared the first round and was called for the second coding round. I expected a normal data structure coding round or ETL/data engineering questions. However, I was asked to code a web-crawler.

This was a very frustrating experience. I have 5-6 years of data engineering experience, and I applied for a data engineering position. Asking me to code a web-crawler felt inappropriate. The interviewer was Chinese, and during the interview, I got the impression they intended to hire a Chinese candidate. Therefore, I did not attempt the question.

It was a negative experience.

Code for a web crawler.