Skip to content

Traces

A trace is the record of one request: every step it took (retrieval, reranking, model calls, tool calls, hand-offs between agents), how long each took, and the tokens each used, with the input and output. Operate › Traces lists a tenant’s traces, newest first, and opens any one of them.

Traces are where content lives. A run records what an agent did and what it used; its trace records what was said.

Tracing is a platform setting, off by default. When it is off, this page, Conversations’ traces and the observability overview say Observability is not configured. A tenant user is asked to have a platform admin turn it on. A platform admin turns it on in the platform configuration; see Configuration.

Traces are kept for the platform’s trace retention window, which is separate from the retention of runs and conversations. See Data retention.

Admin, Builder and Auditor, and platform admins. A Reviewer judges answers from conversations and does not see traces; an End user does not see this page.

  1. The page header, with the tenant picker.
  2. The Recent traces table, “the most recent model requests for this tenant, newest first”, with Search traces.
  3. Load more traces under the table, when there are more. While a search is applied, the button reads Search older traces: a search reads a stretch of the history at a time, so select it to look further back.
Column What it shows
Time When the request started.
Trace What happened, in words: Agent run: <agent>, Tool call: <tool>, Model call: <model> or Embeddings: <model>. A link that opens the trace.
Latency How long the request took.
Tokens Tokens used.
Spans How many steps the trace holds.
Environment The environment the request ran in.

When no trace has been recorded, the page says No traces yet: run a query in the Playground, an assistant or a collection, and its trace appears.

Selecting a trace opens it in a panel beside the list, so you can step through several without leaving the page. The panel holds the same sections as the full page and offers Open full page.

The full page is the one to link to, bookmark or hand to a colleague. It has four tabs:

Tab What it shows
Overview Time, Latency, Tokens, Conversation (a link to the conversation the trace belongs to) and Environment.
Spans The steps as a tree, each with its timing and tokens.
Input/output The request’s Input and Output, each with Copy and Show more.
Scores The verdicts on the answer this trace produced, with Judge its answers in the conversation. A trace that produced no stored answer says Nothing here to score.

When the platform publishes the address of its tracing service, the trace also offers a link that opens it there. Back to traces returns to the list.

If a trace cannot be found, it may have passed its retention window, or the link names another tenant’s trace.

  1. Type in Search traces.
  2. If what you want is older, select Search older traces until it appears.

On Runs, select Trace on a row, or View trace on a run’s page.

On the trace’s Overview tab, select the link beside Conversation.

On the Scores tab, select Judge its answers in the conversation.

Limit Value
Traces per page 100
Content shown Only the steps the tenant’s own scope can see