Senior Backend Engineer | AI Inference Platform & Distributed Systems

Randstad · Singapore

Sector
AI
Function
Product & Engineering
Level
Mid-Level
Employment type
Full Time
Posted
2026-11-17
Source
mycareersfuture

Architect and scale high-throughput, low-latency API gateways powering enterprise AI model inferenceOwn end-to-end backend development across Go/Python microservices, GPU orchestration, and open-source inference enginesAbout the companyAs an innovative leader in artificial intelligence infrastructure, this organization builds developer-first platforms that simplify access to foundation models. The company is committed to advancing scalable cloud-native technologies, empowering global enterprises to deploy reliable AI applications seamlessly.About the jobYour role involves:Architecting and evolving a fault-tolerant, secure backend platform that serves enterprise AI inference workloads at scaleBuilding core platform services including unified API protocol layers, identity and access management, dynamic request routing, and usage metering/billing enginesDesigning seamless technical integrations to connect the inference platform with diverse enterprise client environmentsImplementing deep system observability while continuously optimizing service latency, compute efficiency, and overall platform reliabilityEvaluating and integrating emerging open-source AI inference technologies into production workflows to elevate system throughputDriving full-lifecycle software delivery—from architectural design and automated testing to production rollout and root cause incident analysisSkills and experience requiredAs a successful applicant, you will have:Master's or PhD in Computer Science/Engineering (or equivalent experience) with 5+ years of backend engineering experience in large-scale or AI infrastructureStrong programming expertise in Go, Python, or comparable systems-level backend languagesDeep hands-on mastery of distributed systems, microservices architecture, middleware, and network protocols in high-availability production environmentsPractical working knowledge of GPU computing concepts, AI inference architectures, Linux, containers, and Kubernetes orchestrationProven engineering judgment to balance system reliability, performance optimization, architectural complexity, and delivery velocityProduction experience integrating inference frameworks (such as vLLM, TensorRT-LLM, or SGLang) or optimizing distributed GPU model serving (Advantage)Whats on offerShape the foundational architecture of an AI-native platform used by developers and enterprises to run next-generation models in production. You will thrive in a high-ownership engineering culture that encourages continuous experimentation with cutting-edge open-source inference stacks.To apply online please use the 'apply' function, alternatively you can reach me at https://www.linkedin.com/in/hoonteck-nologyrecruitment. (EA: 94C3609/ R1219669)

Apply on mycareersfuture →
AI AI Kubernetes Automated Software Testing High Availability ensure service performance Middleware Python