Mastered Big Data Pipelines
Mastered Big Data Pipelines
• Built complex Terabyte-scale data pipelines and presentation layers using Cascading for consumption by loan performance analysis models. • Extracted TBs of data from SQL Server and Teradata to the One Lake. • Worked with the Spark ecosystem using Spark SQL and Scala queries on different formats like Parquet files and CSV files. • Implemented Spark using Scala and Spark SQL for faster testing and processing of data, responsible for managing data from different sources.
• Big Data Technologies: Hadoop, MapReduce, Hive, Pig, Scoop, Spark, Kafka. • Machine Learning: Classification, Regression, Clustering, Feature engineering, Ensemble Learning. • Statistics: Bayesian analysis, Time series and Multivariate data analysis. • Languages: Python, R, SQL, Scala. • NoSQL Databases: HBase, Cassandra, MongoDB. • Cloud Platform: Azure, AWS. • DBs & Tools: SQL Server, Azure Data Factory, ETL – SSIS/SSRS/SSAS, Tableau, Power BI. • Version control: GIT, TFS, Confluence, BitBucket.
Additional Ratings
Was this helpful?
Capital One Interview Questions
Capital One Interview Experiences
Data Engineer
There were 3 rounds: * Technical Round 2 * Managerial Round Managerial rounds are worthless. They will present you a rosy picture, but once you start working, you will know there is no career if you want to climb up the ladder.
Data Engineer
Applied through the online portal and was contacted by a recruiter a week later. A screening round was scheduled where both technical and behavioral questions were asked. The interview lasted about half an hour.
Data Engineer
Too technical, but covered all grounds. Enjoyed the process. It kind of boosted my expectations, which is rare. Was stuck at a point, and the hiring manager was kind enough to help me a bit. Was nervous, but hopefully everything went amazing.
Data Engineer
IndiaSeptember 21, 2018There were 3 rounds: * Technical Round 2 * Managerial Round Managerial rounds are worthless. They will present you a rosy picture, but once you start working, you will know there is no career if you want to climb up the ladder.
Data Engineer
Richmond, Virginia, United StatesJuly 1, 2020Applied through the online portal and was contacted by a recruiter a week later. A screening round was scheduled where both technical and behavioral questions were asked. The interview lasted about half an hour.
Data Engineer
McLean, Virginia, United StatesMarch 26, 2026Too technical, but covered all grounds. Enjoyed the process. It kind of boosted my expectations, which is rare. Was stuck at a point, and the hiring manager was kind enough to help me a bit. Was nervous, but hopefully everything went amazing.
