Solutions Architect, Inference Deployments job opportunity at NVIDIA.

Home Jobs In United States Of America Tag: Inference Deployments Solutions Architect, Inference Deployments position at NVIDIA


DateMore Than 30 Days Ago bot
NVIDIA Solutions Architect, Inference Deployments
Experience: General
Pattern: full-time
Country:
apply Apply Now
Salary:
Status:

Inference Deployments

Copy Link Report
degreeGeneral
loacation US, CA, Santa Clara, United States Of America
loacation US, CA, Santa ..........United States Of America

We’re forming a team of innovators to roll out and enhance AI inference solutions at scale, demonstrating NVIDIA’s GPU technology and Kubernetes. As a Solutions Architect (Inference Focus), you’ll collaborate closely with our engineering, DevOps, and customer success teams to foster enterprise AI adoption. Together, we'll introduce generative AI to production! What you'll be doing: Help customers craft, deploy, and maintain scalable, GPU-accelerated inference pipelines on Kubernetes for large language models (LLMs) and generative AI workloads. Enhance performance tuning using TensorRT/TensorRT-LLM, NVIDIA NIM, and Triton Inference Server to improve GPU utilization and model efficiency. Collaborate with multi-functional teams (engineering, product) and offer technical mentorship to customers implementing AI at scale. Architect zero-downtime deployments, autoscaling (e.g., HPA or equivalent experience with custom metrics), and integration with cloud-native tools (e.g., OpenTelemetry, Prometheus, Grafana). What we need to see: 5+ Years in Solutions Architecture with a proven track record of moving AI inference from POC to production on Kubernetes. Experience architecting GPU allocation using NVIDIA GPU Operator and NVIDIA NIM Operator. Troubleshoot sophisticated GPU orchestration, optimize with Multi-Instance GPU (MIG), and ensure efficient utilization in Kubernetes environments. Proficiency with TensorRT-LLM, Triton, and TensorRT for model optimization and serving. Success stories optimizing LLMs for low-latency inference in enterprise environments. BS or equivalent experience in CS/Engineering. Ways to stand out from the crowd: Prior experience deploying NVIDIA NIM microservices for multi-model inference. Serverless Inference, knowledge of FaaS patterns (e.g., Google Cloud Run, AWS Lambda, NVCF) with NVIDIA GPUs. NVIDIA Certified AI Engineer or similar. Active contributions to Kubernetes SIGs or AI inference projects (e.g., KServe, Dynamo, SGLang or similar). Familiarity with networking concepts which support multi-node inference such as MPI, LWS or similar. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 152,000 USD - 218,500 USD. You will also be eligible for equity and benefits . Applications for this job will be accepted at least until January 13, 2026. This posting is for an existing vacancy.  NVIDIA uses AI tools in its recruiting processes. NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Other Ai Matches

Post Silicon Hardware System Integration Engineer' Applicants are expected to have a solid experience in handling Job related tasks
Senior System Software Engineer Applicants are expected to have a solid experience in handling Job related tasks
Graphics Engineer Intern, Tegra System Software - Summer 2026 Applicants are expected to have a solid experience in handling Tegra System Software - Summer 2026 related tasks
Senior Developer Technology Engineer, Public Sector Applicants are expected to have a solid experience in handling Public Sector related tasks
Senior Software Engineer, Object Storage - DGX Cloud Applicants are expected to have a solid experience in handling Object Storage - DGX Cloud related tasks
Mechanical and Thermal Program Manager Applicants are expected to have a solid experience in handling Job related tasks
ASIC Verification Engineer - New College Grad 2026 Applicants are expected to have a solid experience in handling Job related tasks
Director, Software Architecture Applicants are expected to have a solid experience in handling Software Architecture related tasks
Senior Technical Program Manager – VLSI Applicants are expected to have a solid experience in handling Job related tasks
Senior Deep Learning Algorithm Engineer Applicants are expected to have a solid experience in handling Job related tasks
Technical Marketing Engineer Applicants are expected to have a solid experience in handling Job related tasks
Senior Technical Program Manager, Software Compute Platform Applicants are expected to have a solid experience in handling Software Compute Platform related tasks
Applied Atomistic Modeling Researcher, Drug Discovery Applicants are expected to have a solid experience in handling Drug Discovery related tasks
CPU Verification Engineer Applicants are expected to have a solid experience in handling Job related tasks
Software Engineer, Metropolis Vision AI Applicants are expected to have a solid experience in handling Metropolis Vision AI related tasks
Chiplet Physical Design Engineer Applicants are expected to have a solid experience in handling Job related tasks
Senior Software Engineer - Digital Biology Applicants are expected to have a solid experience in handling Job related tasks
Senior HSIO Validation Engineer Applicants are expected to have a solid experience in handling Job related tasks
Senior Timing Engineer - Circuits Applicants are expected to have a solid experience in handling Job related tasks
Senior Software Development Engineer in Test, Confidential Computing - SDET Applicants are expected to have a solid experience in handling Confidential Computing - SDET related tasks
Compute System Architect Applicants are expected to have a solid experience in handling Job related tasks
Software Engineer Intern, 2026 Applicants are expected to have a solid experience in handling 2026 related tasks
Security Lead, L4E Applicants are expected to have a solid experience in handling L4E related tasks