Haystack
← Back to Jobs
Remote
Technology

AI Software Architect

Stellar Professionals LLCColumbia, SC🇺🇸United StatesPosted 29 Jul 2026

Why This Role Stands Out

This fully remote AI Software Architect role offers an exciting opportunity to shape cutting-edge AI solutions and drive innovation within a reputable company. You'll thrive here if you possess a strong background in Generative AI, RAG, and cloud platforms, eager to build secure architectures and explore new AI technologies. Apply now to leverage your expertise and advance your career in a dynamic, growth-oriented environment.

Quick Overview

Work Type
Remote
Level
Mid Senior

Job Description

We are seeking an AI Software Architect to guide the evaluation, design, and responsible implementation of cutting-edge AI solutions across enterprise environments.

Role Details

  • Position: AI Software Architect / AI Consultant
  • Work Arrangement: Fully Remote (Nationwide applicants welcome; must work EST hours. Occasional onsite visits required)
  • Location: Columbia, SC
  • Interview Process: 1 Round (Virtual / Online)

Key Responsibilities

  • Help build secure architectures, reusable technical patterns, and AI prototypes/proof-of-concepts (POCs).
  • Evaluate AI tools, platforms, LLMs, and vendor solutions for governance, privacy, and performance.
  • Design and implement AI Agents and Retrieval-Augmented Generation (RAG) systems.
  • Track AI adoption, cost, and risk through clear performance dashboards and KPIs.

Must-Have Qualifications & Skills

Core AI & Technical Experience

  • Generative AI: 2+ years of hands-on experience with ChatGPT, Microsoft Copilot, and enterprise GenAI platforms.
  • RAG & AI Agents: 2+ years designing and deploying Retrieval-Augmented Generation solutions and autonomous AI agents.
  • Cloud AI Integration: 1+ year integrating AI capabilities natively within Microsoft Azure and AWS.
  • AI-Assisted Coding: 1+ year using tools (e.g., GitHub Copilot, Cursor) for development, testing, and debugging.

Governance, Evaluation & Metrics

  • POCs & KPIs: 1+ year defining success criteria, KPIs, and production monitoring for AI use cases.
  • Dashboards & Reporting: 1+ year building reports to track AI adoption, compute costs, operational risk, and performance.

Education

  • Bachelor's degree in Computer Science, Data Science, AI, or a related technical field (Master's degree preferred).

Bonus / Preferred Skills

  • Background in core programming languages and software engineering best practices.
  • Deep understanding of Transformers, ANNs, Natural Language Processing (NLP), and time-series data.
  • Strong expertise in data engineering, data cleaning, and vector/relational storage.

Skills

AWS
NLP
Azure
Generative AI

Similar jobs