Start searching
Back to Jobs
Recently postedTechnology

AI/ML Test Automation Engineer

SDH SystemsSan Francisco, CA🇺🇸United States

Quick overview

SeniorityMid Senior
Work modeHybrid
LocationSan Francisco, CA, United States
DockerSQLGitAWSOWASPScrumSeleniumGitHub ActionsJMeterJenkinsLLMPlaywrightPostmanPythonk6pytestGenerative AIRESTAzurePostgreSQLKubernetesAgilePrompt EngineeringCI/CDAzure DevOpsLangChainRAG

Job description

SDh Systems is hiring AI/ML Test Automation Engineer with min. 8+ Years exp

Job Title: AI/ML Test Automation Engineer

Location: Austin, TX

Interview: Video (2 round)

Work Schedule: Hybrid (3 Days aweek)

Required Skills

  • Programming: Python, Pytest, Data Structures, Algorithms, REST APIs

  • AI/LLM Testing: LLM Validation, Generative AI Testing, RAG Testing, Prompt Engineering, Hallucination Detection

  • AI Security: Prompt Injection, Jailbreak Testing, Data Leakage Prevention, Authentication, Authorization, RBAC, OWASP LLM Top 10

  • Performance Testing: JMeter, Locust, k6, Load Testing, Stress Testing, Scalability Testing, Performance Monitoring

  • Test Automation: Selenium, Playwright, Pytest, API Automation, Postman

  • AI Frameworks & Tools: LangChain, LlamaIndex, Ragas, DeepEval, Promptfoo

  • AI Platforms: OpenAI API, Azure OpenAI, AWS Bedrock

  • AI Coding Assistants: GitHub Copilot, ChatGPT, Claude

  • Databases: SQL, PostgreSQL, Vector Databases, Pinecone, FAISS

  • DevOps & CI/CD: Git, GitHub Actions, Jenkins, Azure DevOps, Docker, Kubernetes

  • Methodologies: Agile, Scrum, Continuous Testing, Shift-Left Testing

Must-Have Skills: Python, AI/LLM Testing, RAG Validation, AI Security Testing, Performance Testing, API Automation, and CI/CD.

Similar jobs

Apply