Job Description - NVIDIA GPU Server Hardware Infrastructure Engineer
JOB DESCRIPTION The NVIDIA GPU server hardware requirement is for candidates with NVIDIA GPU configuration or architecture exposure, supported by infrastructure skills such as cloud infrastructure, storage management, and Kubernetes configuration on bare-metal or virtual-machine environments. Candidates need to understand CPU and RAM configuration, storage allocation, and ideally GPU allocation for AI model hosting.
The primary requirements are infrastructure expertise in GPU and CPU configuration and Kubernetes setup, including configuring GPU resources, establishing the Kubernetes environment, and hosting LLM or SLM models. The role requires experience in designing and implementing GPU infrastructure rather than responding to hardware requests.
REQUIREMENTS
NVIDIA GPU configuration and architecture exposure
Cloud infrastructure experience with AWS, Bedrock, or Azure OpenAI Foundry
Storage management expertise
Kubernetes configuration on bare-metal or virtual-machine environments
Understanding of CPU and RAM configuration and storage allocation
GPU allocation for AI model hosting
Experience designing and implementing GPU infrastructure architecture
Kubernetes setup and GPU resource configuration
Experience hosting LLM or SLM models
Direct experience with NVIDIA GPU models, hosting environments, and GPU allocation (preferred)
Experience with CUDA, Run:AI, and Terraform automation (additional, not essential)
All Job Ads are subject to GrabJobs’s Terms of Service. We allow users to flag postings that may be in violation of those terms. Job Ads may also be flagged by GrabJobs moderation team. However, no moderation system is perfect, and flagging a posting does not ensure that it will be removed.
Be the first to receive the latest Others Full-Time Jobs in India.
Setup your job alert:
By activating job alerts, I agree to GrabJobs Terms & Privacy Policy. I can unsubscribe to job alerts anytime.
Skip