LLM Ops Engineer

LLM Ops Engineer

Join to apply for the LLM Ops Engineer role at LSEG.

About The Role

We are seeking a skilled and proactive LLM Ops Engineer with expertise in Large Language Model (LLM) Operations to join our growing AI and software development team. This role is critical in ensuring the reliability, performance, and evolution of LLMs and data pipelines in production environments. You’ll understand the roles of Platform, AI Engineering, Governance and Product. Our technical stack includes tracing, annotations, experiments and plans to build a Data Science Workspace. You’ll help maintain the pipelines, experimentation platform and data science workspace, likely with tools such as Langfuse.

Responsibilities

• Data & System Integration
• Configure platform integrations, manage LLM Ops stack components such as DSQ, Langfuse, and integrations for AI components.
• Work with data scientists and engineers to ensure high‑quality, real‑time data feeds into LLM systems.
• Build and maintain observability tools for data quality, model behaviour, and system health.

Model Lifecycle Management

Manage deployment, versioning, and rollback of LLMs in production.

Coordinate and execute model upgrades with minimal service disruption.

Implement CI/CD pipelines for model deployment and testing.

LLM Monitoring & Maintenance

Monitor LLM performance in production (latency, accuracy, user feedback).

Detect and address LLM drift and data drift using automated tools and custom metrics.

Collaborate with data scientists to refine model evaluation criteria.

Required Skills & Experience

• Proven experience in LLM Ops, MLOps, or AI infrastructure roles.
• Strong understanding of LLM behaviour, fine‑tuning, and prompt engineering.
• Experience with monitoring tools (Prometheus, Grafana, MLflow, Evidently AI).
• Experience with AWS Bedrock LLM models.
• Proficiency in Python and familiarity with ML frameworks such as Hugging Face Transformers and LangChain.
• Experience with cloud platforms (AWS, Azure, or GCP) and containerization (Docker, Kubernetes).
• Experience in model optimisation and data drift detection, model drift analysis, and automated retraining pipelines.
• Excellent communication and collaboration skills.

Desired Skills & Experience

• Experience working in agile software development environments.
• Knowledge of data privacy, model interpretability, and responsible AI practices.
• Contributions to open‑source LLM or MLOps projects.
• Experience in the finance sector and/or risk management.

Career Stage

Senior Associate

Company Overview

LSEG is a leading global financial markets infrastructure and data provider. Our purpose is driving financial stability, empowering economies and enabling customers to create sustainable growth. Our values—Integrity, Partnership, Excellence and Change—underpin our culture. We are proud to be an equal opportunities employer and we support sustainability across our business.

Benefits include healthcare, retirement planning, paid volunteering days and wellbeing initiatives. LSEG offers a range of tailored benefits and support.

We are an equal opportunities employer. We do not discriminate based on race, religion, colour, national origin, gender, sexual orientation, gender identity, expression, age, marital status, veteran status, pregnancy or disability, or any other basis protected under applicable law.

Contact: Please take a moment to read our privacy notice for information about personal data processing by LSEG.

#J-18808-Ljbffr