NVIDIA Logo

NVIDIA

Senior Solutions Architect, Generative AI Deployment and AIOps

Posted 4 Days Ago
Be an Early Applicant
In-Office or Remote
4 Locations
184K-288K Annually
Senior level
In-Office or Remote
4 Locations
184K-288K Annually
Senior level
Partners with customers and internal teams to design, deploy, and optimize generative AI and LLM inference solutions. Develops proofs of concept, supports NVIDIA technology adoption, analyzes AI workload performance and power efficiency on Kubernetes, and advises developers, researchers, and data scientists. The role requires expertise in deep learning frameworks, GPU orchestration, MLOps, containerization, observability, and LLM inference, with occasional travel to conferences and customers.
The summary above was generated by AI

NVIDIA is seeking outstanding AI Solutions Architects to assist and support customers that are building solutions with our newest AI technology. At NVIDIA, our solutions architects work across different teams and enjoy helping customers with the latest Accelerated Computing and Deep Learning software and hardware platforms. We're looking to grow our company, and build our teams with the smartest people in the world. Would you like to join us at the forefront of technological advancement? You will become a trusted technical advisor with our customers and work on exciting projects and proof-of-concepts focused on inference for Generative AI and Large Language Models (LLMs). You will also collaborate with a diverse set of internal teams on performance analysis and modeling of inference software. You should be comfortable working in a dynamic environment, and have experience with Generative AI, LLMs and GPU technologies. This role is an excellent opportunity to work in an interdisciplinary team at NVIDIA!

What You Will Be Doing:

  • Partnering with other solution architects, engineering, product and business teams. Understanding their strategies and technical needs and helping define high-value solutions

  • Dynamically engaging with developers, scientific researchers, and data scientists, gaining experience across a range of technical areas

  • Strategically partnering with lighthouse customers and industry-specific solution partners targeting our computing platform

  • Working closely with customers to help them adopt and build creative solutions using NVIDIA technology and MLOps solutions

  • Analyzing performance and power efficiency of AI inference workloads on Kubernetes

  • Some travel to conferences and customers may be required (20%)

What We Need To See:

  • BS, MS, or PhD in Computer Science, Electrical/Computer Engineering, Physics, Mathematics, other Engineering or related fields (or equivalent experience)

  • 8+ years of hands-on experience with Deep Learning frameworks such as PyTorch and TensorFlow

  • Strong fundamentals in programming, optimizations, and software design, especially in Python

  • Proficiency in problem-solving and debugging skills in GPU orchestration and Multi-Instance GPU (MIG) management within Kubernetes environments

  • Experience with containerization and orchestration technologies, monitoring, and observability solutions for AI deployments

  • Excellent knowledge of the theory and practice of LLM and DL inference

  • Excellent presentation, communication and collaboration skills

Ways To Stand Out From The Crowd:

  • Prior experience with DL training at scale, deploying or optimizing DL inference in production

  • Experience with NVIDIA GPUs and software libraries such as NVIDIA NIM, Dynamo, TensorRT, TensorRT-LLM

  • Excellent C/C++ programming skills, including debugging, profiling, code optimization, performance analysis, and test design

  • Familiarity with parallel programming and distributed computing platforms
     

#NALASAHiring

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until September 1, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

NVIDIA Austin, Texas, USA Office

Austin, United States

Similar Jobs

18 Days Ago
In-Office or Remote
4 Locations
184K-288K Annually
Senior level
184K-288K Annually
Senior level
Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
As a Senior Solutions Architect, you will assist customers in building solutions with NVIDIA's AI technology, focusing on Generative AI and Large Language Models while collaborating across teams for performance analysis.
Top Skills: AIDeep LearningDockerDynamoGpuKubernetesLlmNvidia NimPythonPyTorchTensorFlowTensorrt
14 Minutes Ago
Easy Apply
Remote
USA
Easy Apply
254K-299K Annually
Senior level
254K-299K Annually
Senior level
Artificial Intelligence • Blockchain • Fintech • Financial Services • Cryptocurrency • NFT • Web3
Define the technical vision and multi-quarter strategy for Coinbase’s FinHub financial infrastructure. Architect scalable ledger and money-movement primitives across fiat and crypto, ensuring double-entry accounting, idempotency, reconciliation, auditability, reliability, and safe failure recovery. Lead complex cross-team architectural initiatives, collaborate with finance, risk, compliance, and operations stakeholders, and mentor senior engineers while improving system design and operational excellence.
Top Skills: Asynchronous WorkflowsDistributed SystemsGenerative AiGoJavaPythonState Machines
14 Minutes Ago
Easy Apply
Remote
USA
Easy Apply
135K-159K Annually
Mid level
135K-159K Annually
Mid level
Artificial Intelligence • Blockchain • Fintech • Financial Services • Cryptocurrency • NFT • Web3
Own Coinbase’s end-to-end privacy incident management program, serving as incident commander for personal-data incidents. Coordinate triage, investigation, remediation, escalations, notification workflows, retrospectives, metrics, and process improvements across Privacy, Legal, Security, Product, Engineering, and Communications. Maintain on-call readiness, build automation, analyze cloud-native environments using SQL and Python, and support privacy initiatives involving global regulations, privacy controls, and responsible generative AI use.
Top Skills: AirflowGenerative AiLookerMongoDBPostgresPythonSnowflakeSQL

What you need to know about the Austin Tech Scene

Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.

Key Facts About Austin Tech

  • Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
  • Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
  • Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
  • Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account