We're hiring a Senior Server Administrator to join our client’s AI Engineering team. This role is pivotal in deploying, maintaining, and optimizing high-performance computing infrastructure leveraging NVIDIA GPU technologies. You will collaborate with AI researchers, data scientists, and software engineers to ensure systems are robust, scalable, and tuned for cutting-edge machine learning workloads.
Job Title: Senior Server Administrator
Location: Chicago/ Peoria, Cary, Phoenix
Contract: 12 Months
Work Environment: Hybrid: 1 day/week onsite, transitioning to 5 days/week onsite when notified.
Hourly Rate: $70-75 (W2)
Key Responsibilities:
- Administer and maintain GPU-accelerated servers and clusters (NVIDIA A100, H100, etc.).
- Manage and optimize NVIDIA software stack (CUDA, cuDNN, TensorRT, NCCL, NGC containers).
- Monitor system performance, troubleshoot issues, and ensure high availability.
- Support containerized workflows (Docker, Kubernetes) and distributed training environments.
- Implement security best practices and compliance standards.
- Lead upgrades, patching, and lifecycle management of GPU servers.
- Provide documentation, automation scripts, and training for internal teams.
What We’re Looking For:
- Bachelor’s Degree with 8+ years of experience, including 5+ years in server administration and 3+ years with NVIDIA GPU-based systems.
- Strong Linux administration skills in HPC or AI environments.
- Hands-on experience with NVIDIA GPU drivers, CUDA toolkit, and performance tuning.
- Familiarity with Slurm, Kubernetes, and orchestration tools.
- Experience with monitoring tools (Prometheus, Grafana) and automation (Ansible, Terraform).
- Strong scripting skills (Bash, Python).
Strong expertise in:
- NVIDIA Certified Professional or similar credentials.
- Experience with multi-GPU/multi-node training setups.
- Familiarity with AI/ML frameworks (PyTorch, TensorFlow).
- Exposure to cloud-based GPU infrastructure (AWS, Azure, GCP).
About us:
Harvey Nash is a national, full-service talent management firm specializing in technology positions. Our company was founded with a mission to serve as the talent partner of choice for the information technology industry.
Our company vision has led us to incredible growth and success in a relatively short period of time and continues to guide us today. We are committed to operating with the highest possible standards of honesty, integrity, and a passionate commitment to our clients, consultants, and employees.
We are part of Nash Squared Group, a global professional services organization with over forty offices worldwide.
For more information, please visit us at https://www.harveynashusa.com/
Harvey Nash will provide benefits please review: 2025 Benefits -- Corporate
Regards,
Phani Pinisetty
phani.pinisetty@harveynash.com
