Quick overview
Job description
Solution Architect
As a Solution Architect, you will play a pivotal role in designing and implementing cutting-edge AI and GPU infrastructure solutions. You will work closely with cross-functional teams to ensure that our technology infrastructure supports high-performance computing needs, especially for AI workloads. Your expertise will be crucial in optimizing and scaling our GPU infrastructure to meet the demands of advanced machine learning and data processing tasks.
Responsibilities
- Design and implement GPU infrastructure architecture to support AI and machine learning workloads.
- Deploy and manage GPU clusters using both NVIDIA and AMD GPU architectures.
- Optimize performance and scalability of AI workloads in production environments.
- Develop and deploy multi-node GPU deployments using Kubernetes for orchestration.
- Perform GPU sizing and capacity planning to ensure efficient resource utilization.
- Collaborate with development teams to integrate LLM inference solutions into our infrastructure.
- Utilize Infrastructure as Code (IaC) to automate the deployment and management of GPU infrastructure.
- Conduct technical pre-sales and solution architecture engagements to understand client needs and propose suitable solutions.
- Optimize GPU performance using CUDA and ROCm programming frameworks.
- Administer Linux systems to ensure the stability and security of the infrastructure.
- Develop and maintain Python scripts for automation and monitoring of the infrastructure.
Requirements
<>Required Skills- Expertise in GPU Infrastructure Architecture and GPU Cluster Deployment.
- In-depth knowledge of NVIDIA GPU Architecture and AMD Instinct GPU Architecture.
- Experience with LLM Inference and AI Infrastructure Architecture.
- Ability to scale production AI workloads effectively.
- Proficiency in deploying and managing multi-node GPU deployments.
- Strong understanding of Kubernetes for container orchestration.
- Advanced Python Programming skills for automation and scripting.
- Expertise in Linux Administration to manage server environments.
- Knowledge of CUDA and ROCm for GPU performance optimization.
- Experience with Infrastructure as Code (IaC) for automating infrastructure setup.
- Ability to perform GPU Sizing and Capacity Planning for infrastructure design.
- Experience in Technical Pre-Sales and Solution Architecture engagements.
- Experience with GPU Performance Optimization techniques.
Similar jobs
- PM

Senior Strategic Solutions & Story ArchitectRecently posted Auto Apply
Precision Medicine Group · Remote · Remote 🇺🇸
Stakeholder ManagementMicrosoft PowerPointArticulate+3$117.4k/yr - PF

Senior Strategic Solutions & Story ArchitectRecently posted Auto Apply
Precision for Medicine · Remote · Remote 🇺🇸
Stakeholder ManagementMicrosoft PowerPointArticulate+3$117.4k/yr - NC
Solutions ArchitectRecently posted Auto Apply
NT Concepts · Chantilly · Hybrid 🇺🇸
DynamoDBMicroservicesGit+11Technology$131.4k - $244.0k/yr - FT

Java/JEE Solution Architect in Katy, TX (Hybrid role)Recently posted
FSTONE Technologies · Katy, TX · Hybrid 🇺🇸
MicroservicesSpringSpring Boot+2TechnologySalary not listed - SR

Solution Architect - McLean, VA - Face to Face InterviewRecently posted
Sun Radia · McLean, VA · On-site 🇺🇸
MicroservicesGenerative AIAgileTechnologySalary not listed - ZC

Oracle EPM FCCS ArchitectRecently posted
Ztek Consulting · Dallas, TX · Hybrid 🇺🇸
Stakeholder ManagementOracleERP+6Salary not listed - KT

Solution Architect (Cloud, IoT, AI Driven)Recently posted
Kforce Technology Staffing · Armonk, NY · Hybrid 🇺🇸
IoTLLMTechnologySalary not listed - BA

Manager, Solutions ArchitectRecently posted Auto Apply
Baseten · San Francisco · Hybrid 🇺🇸
DockerLLMNotion+2TechnologySalary not listed - AT
AI Solution ArchitectRecently posted
Arkhya Tech Inc. · Durham, NC · Hybrid 🇺🇸
Stakeholder ManagementMLOpsGenerative AITechnologySalary not listed - WS
WMS Solution ArchitectRecently posted
Wise Skulls · Chicago, IL · On-site 🇺🇸
Stakeholder ManagementOracleTechnologySalary not listed - TR

Solutions Architect / Technical LeadRecently posted
Tech Rakers · United States · Remote 🇺🇸
SQLAWSDatabricks+5TechnologySalary not listed - AN

Senior Solutions ConsultantRecently posted Auto Apply
Anaplan · Texas-Remote · Remote 🇺🇸
RecruitingERPCustomer Success+4Salary not listed