Senior Software Engineer (Tech MNC/ AI Platform/ LLM/ UP12K+)

The OpportunityAdecco is partnering our client, a famous Tech MNCWe are looking for a Senior Software EngineerThe role will start out as a 6-months contract (renewable)Candidates who are immediately available/ able to start work within short notice will be preferredThe TalentMinimum of 2 years experience in or at at least most:EvalsHub, LangSmith, LangGraph/LangChain, FastAPI, Temporal, Grafana, Redis, or similar technologies.React/TypeScript and internal developer-tooling interfaces.LLM-as-judge, multi-turn evaluation, tool/MCP evaluation, and agent-trajectory analysis.Text-to-SQL/Text-to-DSL, RAG, semantic retrieval, embedding evaluation, or model benchmarking.Building platform capabilities that can be reused across several AI products.Strong analytical and problem-solving skills related to geo dataExcellent project management and cross-department communication abilitiesDetail-oriented and metrics-driven approach to continuous improvementJob DescriptionEmbed with AI product teams and own measurable agent-quality outcomes.Build and maintain golden datasets, regression suites, evaluation pipelines, and quality dashboards.Convert product rules and human review procedures into deterministic, numeric, LLM-as-judge, trajectory, tool-selection, SOP-adherence, and multi-turn evaluators.Diagnose evaluation and production-trace failures, then convert findings into dataset improvements, evaluator changes, or fixes to prompts, tools, skills, and agent workflows.Instrument distributed agent systems using OpenTelemetry, including Temporal workflows and Go/Python services.Ensure traces contain consistent inputs, outputs, tool calls, metadata, feedback, and root-agent results.Develop reusable capabilities across EvalsHub backend, SDK, CLI/plugins, and supporting frontend interfaces.Integrate evaluations into CI/CD and model-release workflows.Run model, retrieval, embedding, and agent-architecture experiments; balance accuracy, latency, and cost.Drive migrations from legacy evaluation and observability systems.Write technical designs and documentation, run demonstrations, and enable engineering teams to use evaluation tooling independently.Participate in the LLMOps operational rotation and support production-quality integrations.Next StepPrepare your updated resumeSend your resume to [email protected] shortlisted candidates will be contactedLiu XinYangEA Licence Number: 91C2918Personnel Registration Number: R1988872