AI Engineer (QC Automation)
Human Union Data Singapore · Singapore
HUD builds the infrastructure for training and evaluating AI agents. Our platform lets teams create reinforcement learning (RL) environments, benchmarks and evaluations, and our marketplace connects data vendors with frontier AI labs.You will build the quality control (QC) systems that decide whether training data delivered to AI labs meets our standards.Key responsibilitiesDefine and enforce quality standards for agent training dataBuild auditing systems for supplier datasets, including sampling, rule-based checks, model-assisted validation and feedback loopsDesign metrics and experiments to grade agent outputsWork with data vendors to diagnose quality issues and agent failure modesBuild QC findings into internal tools and the vendor portalRequirementsDegree in Computer Science, Engineering or a related field, or equivalent practical experienceSolid software or machine learning engineering skills, shown through work, internships, research or projectsStrong Python, Docker and Linux skillsExperience building validation pipelines and automated QA/QC end to endExperience with benchmarks and evaluationsGood to haveBackground in statisticsExperience designing QA processes or new evaluation tasksWork location: On-site at our Singapore office, 9 Battery Road (Raffles Place). Full-time, permanent. 21 days of annual leave; CPF contributions for eligible employees.We assess candidates on their skills and the work they can show us, such as projects, research, internships, open-source or previous jobs, rather than years of experience.4. AI Engineer (Benchmarks)S$10,700–18,700/month · EP occupation: AI EngineerHUD builds the infrastructure for training and evaluating AI agents. Our platform lets teams create reinforcement learning (RL) environments, benchmarks and evaluations, and our marketplace connects data vendors with frontier AI labs.You will own the design, build and quality of our internal benchmarks for AI agents.Key responsibilitiesDesign realistic benchmark tasks with subject-matter experts across domainsBuild infrastructure to run models and agents against benchmark tasksDevelop metrics for task difficulty, reliability and failure modesCheck that benchmark results track real-world performance and lab expectationsWrite clear documentation and reports on benchmark resultsRequirementsDegree in Computer Science, Engineering or a related field, or equivalent practical experienceSolid software or machine learning engineering skills, shown through work, internships, research or projectsStrong Python, Docker and Linux skillsExperience with environments, benchmarks or evaluations for ML modelsPublished papers or technical blog posts on related topics (please include links)Good to haveStrong attention to detail in spotting inconsistencies and edge casesExperience at an early-stage startupWork location: On-site at our Singapore office, 9 Battery Road (Raffles Place). Full-time, permanent. 21 days of annual leave; CPF contributions for eligible employees.We assess candidates on their skills and the work they can show us, such as projects, research, internships, open-source or previous jobs, rather than years of experience.