Senior Software Engineer(AI & LLM) - 12 Months Contract - up to SGD12k -

We are seeking a Senior Software Engineer to own our ACS embedded-evaluation workstream. You will embed with AI product teams to build the infrastructure, automated pipelines, and observability tools that ensure our LLM agents perform accurately, cost-effectively, and reliably at scale.Key ResponsibilitiesAI Evaluation Infrastructure: Own and scale EvalsHub (backend, SDK, CLI, frontend). Build golden datasets, regression pipelines, and CI/CD model-release integration.Advanced Automation: Convert human review procedures into LLM-as-judge, multi-turn, trajectory, and deterministic evaluators to eliminate manual testing.Observability & Tracing: Instrument distributed agent systems using OpenTelemetry across Go/Python services and Temporal workflows to ensure flawless debugging data.Optimization: Run experiments across model architectures, RAG, and embeddings to balance accuracy, latency, and cloud costs.Enablement: Author technical docs, lead tool migrations, and participate in the LLMOps production operational rotation.RequirementsEducation: Bachelor's degree in Computer Science or related field.Experience: Minimum 2+ years of relevant software engineering experience.AI & Workflow Ecosystem: Hands-on with LangSmith, LangGraph/LangChain, FastAPI, or Temporal.AI Domain Expertise: Proven track record in LLM-as-judge frameworks, agent-trajectory analysis, RAG, semantic retrieval, or Text-to-SQL.Data & Core Tech: Strong analytical skills handling geospatial data. Proficiency in React/TypeScript (for developer tools), Grafana, and Redis.Soft Skills: Metrics-driven problem solver with excellent cross-functional communication skills.Interested candidates may apply through the application system or send it to [email protected]. Shortlisted candidates will be notified.By sending us your personal data and curriculum vitae (CV), you are deemed to consent to Morgan Mckinley Pte Ltd and its affiliates to collect, use and disclose your personal data for the purposes set out in the Privacy Policy available at https://www.morganmckinley.com/sg/privacy-policy. You acknowledge that you have read, understood, and agree with the Privacy Policy.Morgan McKinley Pte LtdKoh Boon SienEA Licence No: 11C5502EA Registration No. R1110345