Attractive Job Opening for Automation QA Engineer in Singapore

Talent Xperts · Singapore

Sector
AI
Function
Product & Engineering
Level
Mid-Level
Employment type
Full Time
Posted
2026-08-20
Source
mycareersfuture

Job Description & RequirementsABOUT THIS FEATURED OPPORTUNITYThe QA Engineer will join the Channel Sales andOperations team to help ensure the reliability and quality of our AI/ML-poweredB2B chatbot and the foundational platforms supporting it. This role goes beyondtesting outputs you'll be working closely with engineers to ensure theend-to-end system, including cloud infrastructure and data pipelines, functionsas intended.THE OPPORTUNITY FOR YOUDesign and execute manual and automated test cases for GenAI platforms and chatbot systems.Build and maintain Python-based test automation frameworks for backend services and ML pipeline validation.Utilize RAGAS or similar tools to assess LLM outputs for factuality, relevance, and system performance.Conduct end-to-end testing from data ingestion to user-facing output.Validate system stability across GCP cloud components compute, storage, networking, and containers.Identify failures not only in chatbot answers, but also in underlying infrastructure and platform behavior.Collaborate with DevOps and ML engineers to triage bugs and optimize performance.Ensure test coverage spans across multiple deployment environments including Kubernetes clusters and cloud VMs.RequirementsKEY SUCCESS FACTORS3+ years of QA Automation Engineering experienceExperience with Playwright for automated application testing, including sign-in and SSO authentication flowsAbility to design tests that validate output accuracy and system behavior across different user flowsExperience with Python API testing using requests, Pytest, and integration into CI/CD and cloud environmentsProficiency in writing and debugging Bash scripts used in CI/CD and cloud deployment workflowsExperience with Cloud platforms ( GCP preferred), including Kubernetes (kubectl experience is a plus), virtual machines, databases, cloud networking and storage componentsUnderstanding of modern cloud architecture and how distributed components interconnect in production environmentsNICE TO HAVESExperience with LLM testing frameworks like RAGAS , and ability to interpret metrics such as factuality, relevance, and performanceExperience with monitoring and observability toolsFamiliarity with the end-to-end architecture of GenAI solutions , including vector stores, retrievers, embedding models, and inference systems

Apply on mycareersfuture →
AI Cloud Technologies Distributed Platforms Application Testing Kubernetes implementing monitoring tools Database Systems User Testing