Data Engineer

Roles & ResponsibilitiesResponsibilitiesDesign and build backend services using Python and FastAPIDevelop, test, and deploy GenAI applications in a production settingBuild and maintain LLM pipelines (e.g., OpenAI, HuggingFace Transformers, LangChain)Construct scalable data pipelines for ingesting and structuring archival contentInterface with graph databases (e.g., Neo4j, Memgraph) for relationship mappingCollaborate with AI/ML engineers, designers, and other stakeholders to integrate LLM outputs with UI and user workflowsImplement CI/CD pipelines and manage on-premise or VM-based deploymentRequirementsGood understanding of a global import export environment & the documentation requirement for the sameFamiliarity in working across ERP systems and system integrations.Strong proficiency in Python, with experience in FastAPIExperience developing and deploying LLM-based applications (Azure OpenAI API, HuggingFace, etc.)Background in data engineering—working with large-scale unstructured text, ETL workflowsFamiliarity with graph databases and knowledge representationExposure to CI/CD pipelines and deploying services in on-premise or virtual machine environmentsTrack record of taking GenAI applications from development to real-world usage