Mastered Big Data Pipelines
Mastered Big Data Pipelines
• Built complex Terabyte-scale data pipelines and presentation layers using Cascading for consumption by loan performance analysis models. • Extracted TBs of data from SQL Server and Teradata to the One Lake. • Worked with the Spark ecosystem using Spark SQL and Scala queries on different formats like Parquet files and CSV files. • Implemented Spark using Scala and Spark SQL for faster testing and processing of data, responsible for managing data from different sources.
• Big Data Technologies: Hadoop, MapReduce, Hive, Pig, Scoop, Spark, Kafka. • Machine Learning: Classification, Regression, Clustering, Feature engineering, Ensemble Learning. • Statistics: Bayesian analysis, Time series and Multivariate data analysis. • Languages: Python, R, SQL, Scala. • NoSQL Databases: HBase, Cassandra, MongoDB. • Cloud Platform: Azure, AWS. • DBs & Tools: SQL Server, Azure Data Factory, ETL – SSIS/SSRS/SSAS, Tableau, Power BI. • Version control: GIT, TFS, Confluence, BitBucket.
Additional Ratings
Was this helpful?
Capital One Interview Questions
Capital One Interview Experiences
Data Engineer
This was a two-panel interview focusing on AWS cloud environments and team conflict resolution, likely using behavioral questions like "Tell me about a time..." to assess experience. For AWS, expect questions about architecture, services (like EC2,
Data Engineer
Capital One's interview process includes: * An online application * Assessment tests * A recruiter screen * Technical interviews (case studies or coding) * Behavioral interviews These interviews focus on problem-solving, leadership, cultu
Data Engineer
HR phone call (go over the interview process) Codesignal: * 4 coding questions (2 easy, 1 medium, 1 very long) Power Day: * 4 one-hour rounds (technical, system design, behavioural, case study) Hiring Manager
Data Engineer
Dallas, Texas, United StatesOctober 1, 2025This was a two-panel interview focusing on AWS cloud environments and team conflict resolution, likely using behavioral questions like "Tell me about a time..." to assess experience. For AWS, expect questions about architecture, services (like EC2,
Data Engineer
United StatesAugust 8, 2025Capital One's interview process includes: * An online application * Assessment tests * A recruiter screen * Technical interviews (case studies or coding) * Behavioral interviews These interviews focus on problem-solving, leadership, cultu
Data Engineer
United StatesAugust 6, 2025HR phone call (go over the interview process) Codesignal: * 4 coding questions (2 easy, 1 medium, 1 very long) Power Day: * 4 one-hour rounds (technical, system design, behavioural, case study) Hiring Manager
