Questions on CUDA kernel, how to optimize models given constraints. Many back and forth discussions, and when mentioning optimization technique, asked to dig deeper, such as kernel fusion and launch overhead.
Implement MoE and show the dimensions.
The following metrics were computed from 292 interview experiences for the Nvidia Software Engineer role.
Nvidia's interview process for their Software Engineer roles is very selective, failing most engineers who go through it.
Candidates reported having very good feelings for Nvidia's Software Engineer interview process.