Senior Data Engineer

We are partnering with a leading organisation to hire a Senior Data Engineer This is an exciting opportunity for a hands-on engineer with strong experience in cloud data platforms, data engineering, streaming technologies, and Generative AI.Key responsibilities include but are not limited to:Design, build, optimise, and operate scalable batch and streaming data pipelines using technologies such as Databricks, Apache Kafka, Microsoft Fabric, and Delta Lake.Develop robust data ingestion, transformation, and serving capabilities across diverse source systems, including files, APIs, databases, and streaming platforms.Use Python, SQL, and PySpark to transform, cleanse, validate, and prepare data for downstream consumption.Lead the implementation and operationalisation of knowledge bases and Retrieval-Augmented Generation (RAG) solutions supporting GenAI and agentic AI use cases across business domains.Build and maintain knowledge bases across a range of hosting platforms, including storage, lifecycle management, embedding, and vectorisation capabilities.To qualify for this Senior Data Engineer role, you should have:A Bachelor’s degree in Computer Science, Engineering, or a related discipline.5 yrearss of experience in data engineering, data platform engineering, or cloud-scale analytics solution delivery.Demonstrated experience owning and operating production data pipelines and platform components.Strong hands-on experience designing, building, optimising, and supporting batch and/or streaming pipelines, including orchestration, observability, error handling, performance tuning, and production support.If this sounds like the right next step for you, please apply with your CV or reach out directly to [email protected] for a confidential discussion.Equal Opportunity StatementTENTEN Partners is an equal opportunity firm and is committed to providing equal employment opportunities to all qualified individuals without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, or any other protected characteristic as outlined by applicable laws.