Senior Deep Learning Performance Architect

What you’ll be doing

• Design and evaluate hardware architectures to improve performance, efficiency, and scalability of production AI workloads.

• Analyze and optimize large-scale deep learning workloads, especially LLM inference/training in real-world deployments.

• Build and use performance and power models (Python/C++) to drive architecture and product decisions.

• Identify and resolve system bottlenecks across compute, memory, and interconnect.

• Evaluate PPA trade-offs and guide feature prioritization for next-generation GPU/ASIC designs.

• Partner closely with software, systems, and product teams to align hardware capabilities with workload requirements.

What we need to see:

• MS or PhD in a relevant field (Computer Science, Electrical Engineering, Computer Engineering, etc) or equivalent experience.

• 5+ years of hands-on experience in GPU/ASIC architecture, parallel computing, or system performance engineering.

• Experience with deep learning workloads in production environments (training and/or inference).

• Proficiency in Python and C++ for building performance models, simulators, or analysis tools.

• Solid understanding of system architecture: memory hierarchy, data movement, and scalability.

• Prior experience debugging, profiling, and performance tuning on real systems.

• Ability to work across team and drive decisions in fast-paced product environments.

Ways to stand out from the crowd:

• Experience translating workload behavior into concrete hardware or system-level improvements.

• Practical experience with LLM inference optimization: batching, disaggregation, KV-cache management, latency/throughput tuning.

• Familiarity with production inference systems (e.g., scheduling, multi-node scaling, resource utilization)

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5.Applications for this job will be accepted at least until May 9, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.