Enterprise Data & AI Platform Engineer
Oversea-chinese Banking · Singapore
Technical SkillsCore Skills (Must Have)Cloudera Data Platform (CDP)Cloudera Machine Learning (CML)Hadoop Ecosystem (HDFS, YARN, Hive, Impala, Ozone) Apache SparkHybrid Cloud Architecture (AWS & On-Premises)AWS Core Services (EC2, EKS, IAM, S3, VPC, CloudWatch)AI/ML Infrastructure Support (GPU, Containers, Kubernetes)AI/ML Services: SageMaker/Bedrock/OpenSearch/Glue/Athena/EMRPreferred SkillsVulnerability Management, Security Patching, Hardening & Compliance ManagementPlatform Upgrade, Migration & Maintenance ActivitiesMicroservices Architecture & REST APIsCertificate & Secrets ManagementOpenShift / Kubernetes AdministrationHybrid Infrastructure Operations (AWS & On-Prem)MLOps Platforms and AI Model Lifecycle ManagementLinux / Unix AdministrationOpenShift / Kubernetes AdministrationPlatform Monitoring, Troubleshooting & Performance TuningGood to HaveCloudera Certifications (CDP, CML, Cloudera Administrator)Big Data Certifications (Spark, Iceberg, Hadoop)AWS Certifications:AWS Certified Solutions ArchitectAWS Certified AI PractitionerExperience with CI/CD Tools (Jenkins, GitLab CI/CD, GitHub Actions, ArgoCD)Infrastructure as Code (Terraform, Ansible, CloudFormation)Experience with SRE Practices, Observability & Monitoring PlatformsExposure to Data Lakehouse Architectures and Apache IcebergExperience supporting Generative AI platforms and LLM workloadsKnowledge of Vector Databases, RAG Architectures and AI GovernanceDevSecOps and Cloud Security Best PracticesMulti-Cloud or Hybrid Cloud Platform ManagementWhy JoinJoin a team that powers OCBC's enterprise Data, Analytics, and AI platforms across hybrid cloud environments. You'll work with leading technologies including Cloudera CDP/CML, AWS Cloud, Big Data, and AI/ML platforms, while driving innovation, reliability, and operational excellence.How You SucceedSuccess in this role comes from your ability to manage and optimize complex hybrid cloud data platforms, automate operations, resolve issues proactively, and collaborate effectively with Data, AI/ML, Infrastructure, Security, and SRE teams.What You DoAdminister and support Cloudera Data Platform (CDP), Cloudera Machine Learning (CML), Hadoop, and Spark environments across AWS and on-premises infrastructure.Manage platform upgrades, security patching, vulnerability remediation, certificate management, and platform hardening activities.Support containerized platforms on Kubernetes, OpenShift, and AWS EKS, ensuring high availability and performance.Monitor, troubleshoot, and optimize Data, Analytics, AI/ML, and Generative AI platforms including AWS services such as SageMaker, Bedrock, EMR, and S3.Automate operational processes using Shell/Python scripting and collaborate with Infrastructure, Security, and SRE teams to improve platform reliability and scalability.Who You AreA degree in Computer Science, Information Technology, or a related fieldAt least 3 years of experience in software development, preferably in a banking or financial services environmentProficient in one or more programming languages, such as Java, Python, or C++Experience with Agile development methodologies and version control systems such as GitStrong problem-solving skills, with the ability to analyze complex technical issues and develop creative solutionsExcellent communication and collaboration skills, with the ability to work effectively with cross-functional teamsDiploma or Degree in Computer Science, Information Technology, Engineering, or a related discipline.5-8 years of experience supporting enterprise Data, Analytics, or AI/ML platforms, with hands-on expertise in Cloudera Data Platform (CDP), Cloudera Machine Learning (CML), Hadoop, and Apache Spark.Strong experience in hybrid cloud environments, including AWS services (EC2, EKS, IAM, S3, CloudWatch) and on-premises infrastructure, with knowledge of Kubernetes/OpenShift and Linux administration.Proven experience in platform operations, upgrade and maintenance activities, security patching, incident management, troubleshooting, and automation using Shell and/or Python scripting.