Greetings from VEST Software
About VTEST
Founded in 2015 in Pune, VTEST (
www.vtestcorp.com) is a pure-play Software Testing services firm based out of Pune, India registered in Atlanta, US and Melbourne, Australia and recognized with
Great Place to Work &
NASSCOM certified. VTEST works with clients across the globe and employs Manual and Automation Testers to implement best testing practices for all types of testing. Our testers work Remote or from VTEST and client offices across India and international locations.
We are developing an engagement system to enhance salespeople's workflows with AI, addressing their needs from start to finish. Our extensive experience in both AI and sales uniquely positions us to tackle this challenge. If you're excited about shaping how AI agents are tested and trusted in real-world enterprise environments, we’d love to hear from you.
Job Skills: Automation Testing - Playwright with AI/ML Testing
Work Mode: Remote
Qualifications: Any Graduate (Yes, at VTEST we accept ANY Graduate irrespective of Specialization, College, University. If you can TEST then apply to VTEST)
Years of Experience: 4+ years
Joining Availability - Immediate
Employment Type - Permanent (Full Time)
What We’re Looking For
- Min 4+ years of experience in QA engineering or test automation.
- Proficiency in writing test scripts using TypeScript or JavaScript.
- Hands-on experience with frameworks like Cypress, Playwright, Pytest, Karate, or similar.
- Experience testing APIs and backend services, and familiarity with CI/CD tools like GitHub Actions or CircleCI.
- Understanding of data validation and end-to-end workflow testing.
- Comfortable solving open-ended or ambiguous problems in fast-paced environments.
- Able to independently manage and prioritize work while driving outcomes.
What You’ll Do
- Define and implement the QA strategy across manual and automated testing, focusing first on backend and AI agent workflows..
- Build and maintain automated test suites using modern tools (e.g., Pytest, Karate, Cypress, Playwright).
- Own quality checkpoints in our CI/CD pipelines and prevent regressions pre-release.
- Validate AI/LLM-based features with a focus on consistency, hallucination detection, and prompt-based output correctness.
- Collaborate closely with ML, platform, and product teams to build testable, observable, and trustworthy systems.
- Actively participate in design reviews, story definitions, and bug triage discussions.
AI Testing Experience – Required for Success
- Prior Experience with testing AI systems is important and will significantly contribute to success in this role.
- Experience testing AI/ML systems, including modern LLM applications, conversational AI, or intelligent agent workflows.
- Familiarity with prompt engineering, non-deterministic output validation, and hallucination detection.
- Ability to design and execute evaluation strategies to validate output correctness, stability, and relevance.
- Exposure to tools like LangChain, Temporal, Weaviate, or Pinecone is a bonus, but not required.
Why Join US:
- Opportunity to work on cutting-edge technologies and innovative products.
- Collaborative and growth-oriented team culture.
- Flexible work setup and professional development support
