Changelog

SSO with GitHub Enterprise and Keycloak

Langfuse now supports GitHub Enterprise and Keycloak as SSO providers on Langfuse Cloud and self-hosted instances

New documentation for Google Vertex AI and Gemini tracing

Comprehensive guides for tracing Google Vertex AI and Gemini models with Langfuse

Launch Week 2 🚀

Prompt Experiments on Datasets with LLM-as-a-Judge Evaluations

Move fast on prompts without breaking things! Run experiments on Datasets and directly compare evaluation results side-by-side. Experimentation speeds up the feedback loop when working on prompts and prevents regressions when making rapid changes.

New Sidebar

We've updated the sidebar in the Langfuse UI collapsible. This change provides more screen space for viewing traces and other complex pages.

Event input and output masking

Configure SDK-side masking to redact sensitive information from inputs and outputs sent to the Langfuse server.

Langfuse LLM-as-a-judge now supports any (tool-calling) LLM

Tool calling makes Langfuse Evals reliable. Previously, only OpenAI models were supported. With this update, you can use any tool-calling LLM when setting up an LLM-as-a-judge evaluator.

Annotation Queues

Manage your annotation tasks with ease using our new workflow tooling. Create queues, add traces to them, and get a simple UI to review and label LLM application traces in Langfuse.

Aggregated and Color-coded Latency and Costs on Traces

Large traces can be hard to read. We've added aggregated latency and cost information to the every span level to make it easier to spot outliers and debug the LLM application.

DSPy Integration Example

Langfuse now provides an integration example for DSPy, offering observability for this powerful framework that optimizes language model prompts and weights.

Custom Base Path for Self-Hosted Deployments

Deploy Langfuse behind a custom base path for more flexible self-hosting configurations.

Token/cost tracking for OpenAI's o1 models

Day 1 support for OpenAI's o1 models including tracking token counts and USD spend.

Headless Initialization of Self-Hosted Deployments

Automatically initialize Langfuse resources on startup using environment variables, streamlining self-hosted deployments and infrastructure-as-code integrations.

Support for Multi-Modal Traces in Langfuse UI

Add multiple modalities to a single trace, including text and images.

Comments on Langfuse objects

Add comments to traces, observations, sessions and prompts via the Langfuse UI.

Advanced Score Analytics Charts

Explore customizable charts for aggregate and time series analytics, grouped by score type, source and name.

UI Customization

You can now replace the documentation, support and feedback links in the UI with references to your internal resources. This helps roll out Langfuse in your organization and ensures that users can find the information they need.

Organizations

Introducing organizations to manage projects and permissions across larger teams working in Langfuse.

Resizable Columns Across All Tables

Tables are at the core of Langfuse and we finally made them resizable.

Render Markdown in Langfuse UI

Display trace or observation inputs and outputs in Markdown format. Enhance the readability of Markdown elements such as headers, lists, blocks of code, tables, and links.

Create Non-Numeric Scores via SDKs

The Langfuse API, Python and JS SDKs now support creating categorical, boolean and numeric scores.

Models API

The Langfuse API now supports direct access to model definitions used for tokenization and model price calculation across the Langfuse platform. You can use the API to synchronize model prices from your model registry or add custom models programmatically.

Datasets API v2

Introduction of the new Datasets API v2 with improved performance for large datasets. Also, now all datasets-related objects are directly accessible via the API.

Dify Integration

Build complex LLM applications with Dify's workflow builder and natively trace and monitor them in Langfuse using the new integration.

Trace Timeline View

Visualize agent flow using our trace timeline chart. This new view helps to identify latency bottlenecks, visualize parallelism, and understand multi-step reasoning in deeply nested chains.

Update Indicator

For self-hosted instances, we have added a little update indicator that helps to keep track of the latest changes to Langfuse. On Langfuse Cloud, you always run on the latest version.

New Docs and Cookbook: Monitoring LLM Security

LLM security requires effective run-time checks and ex-post monitoring and evaluation. We have added new documentation and a cookbook on how to effectively leverage popular LLM security tools while evaluating them in Langfuse.

Annotation Drawer

Annotate traces and LLM responses via the new annotation drawer. You can define a standardized set of scores and criteria for your project.

New Cookbook: Tracing OpenAI Assistants API

The OpenAI Assistants API is a powerful tool for building conversational AI applications while relying on OpenAI to manage state, RAG, code execution and more. The new cookbook provides a step-by-step guide to trace applications built with the API.

Dark Mode

Introducing dark mode for the Langfuse UI.

Prompt Version Insights

Compare metrics across different prompt versions in Langfuse Prompt Management.

Sticky headings on tables

Sticky headings to better keep track of your data.