Quick overview
Job description
What is Contentstack?
Contentstack is redefining how modern digital experiences are built and managed. As the pioneer of the Agentic Experience Platform (AXP), Contentstack brings together structured content and brand governance (Content Cloud), real-time customer data, omnichannel personalization (Data Cloud) and autonomous AI orchestration (Agent OS) into one unified system.
While many organizations adopted headless CMS or standalone AI tools expecting transformation, they often found themselves managing disconnected systems and manual workflows. Contentstack helps enterprises move beyond that complexity by connecting content, data and AI in a way that makes digital experiences faster to launch, easier to manage and more adaptive in real time.
Leading brands including Steve Madden, LG Electronics, Subaru of America, Dolce & Gabbana, ASICS, Decathlon, and Caesars Entertainment rely on Contentstack to reduce operational friction and deliver personalized, scalable digital experiences with confidence. The company is known for its customer-first culture and commitment to the communities it serves through the Contentstack Cares program.
Learn more at www.contentstack.com.
Who Are We?
At Contentstack we are more than colleagues, we are a tribe. Our vision is to pursue equity among our communities, employees, partners, and customers. We are global-diverse yet close; distributed yet connected. We are dreamers and dreammakers who challenge the status quo. We do the right thing, even when no one is watching. We are curious trendspotters and brave trendsetters. Our mission is to make Contentstack indispensable for organizations to tell their stories and to connect with the people they care about through inspiring, modern experiences. We care deeply about our customers and the communities we serve. #OneTeamOneDream. Chalo, let’s go!
Senior Engineer I - QA
Location: Pune
Experience: 5-8 Years
What you will be working on:
Developer Ecosystem Quality
- We are looking for an automation-focused Senior QA Engineer to own quality for the Developer Ecosystem (SDKs, APIs, CLI, developer tooling, marketplace apps and AI-facing integrations such as MCP servers and agent tooling).
- The role should both use AI to raise QA throughput and know how to test AI-powered features.
Roles & Responsibilities
Test Strategy and Automation
- Own the test strategy and automation frameworks for APIs, SDKs and CLI across supported languages.
- Build and maintain CI-integrated regression suites and release-readiness checks.
- Run exploratory and compatibility testing for developer-facing releases.
AI-Assisted QA and AI Feature Testing
- Use AI-assisted workflows (LLM-based test generation, test data creation, failure triage, code review of tests) to speed up coverage while validating the output.
- Design test approaches for AI-powered and agentic features, including MCP tool behavior, prompt and response evaluation, non-deterministic output checks, and regression baselines for model or prompt changes.
Collaboration
- Partner with engineering, product and DevRel to catch issues early and improve developer experience.
- Triage and drive defects to closure and report on quality metrics.
Mandatory Skills
- 5-8 years in QA/SDET with strong API automation (REST/GraphQL).
- Proficiency in JavaScript/TypeScript or Python for test automation.
- Hands-on with CI/CD pipelines and frameworks such as Jest, Mocha, Playwright or pytest.
- Practical experience using AI coding and testing assistants in day-to-day QA work.
- Experience testing SDKs, CLIs or developer platforms is a strong plus.
Preferred Skills
- Exposure to testing LLM or agent-based systems, evals, MCP or similar tool-calling interfaces, and AI-assisted test automation approaches.
What Do We Offer?
Interesting Work | We hire curious trendspotters and brave trendsetters. This is NOT your boring, routine, cushy, rest-and-vest corporate job. This is the “challenge yourself” role where you learn something new every day, never stop growing, and have fun while you’re doing it.
Tribe Vibe | We are more than colleagues, we are a tribe. We have a strict “no a**hole policy” and enforce it diligently. This means we spend time together - with spontaneous office happy hours, organized outings, and community volunteer opportunities. We are a diverse and distributed team, but we like to stay connected.
Bragging Rights | We are dreamers and dream makers. Our efforts pay off and we work with the most prestigious brands, from big-name retailers to airlines, to professional sports teams. Your contribution will make an impact with many of the most recognizable names in almost every industry including AirFrance KLM, ASICS, Burberry, Mattel, Mitsubishi, Walmart, and many more!
One Team One Dream | This is one of our values, and it shows. We don’t believe in artificial hierarchies. If you’re part of the tribe, you have an opportunity to contribute. Your voice will be heard and you will also receive regular updates about the business and its performance. Which, btw, is through the roof, so it’s a great time to be joining…
To review our Privacy Policy, please click here.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Will your resume get past this employer's screening? Check your resume against this job, free
