Skip to content

Conversations

Operate › Conversations shows the conversations in a tenant as one thing each, rather than as separate requests. Open one to read every turn in order, judge its answers, and, where you can read traces, open the trace behind any turn.

What the page lists depends on your role. Roles that read traces see the conversations as tracing groups them: assistant threads and agent runs. A Reviewer sees the tenant’s assistant conversations from Olympusx AI’s own record, with no traces.

Role What the page shows
Admin, Builder, Auditor, platform admin Conversations grouped from traces, each with its turns and traces.
Reviewer The tenant’s assistant conversations, each as its transcript, with no traces.
End user Not available. Your own conversations are in My conversations.
  1. The page header, with the tenant picker.
  2. The Recent conversations table, with a search field (Search conversations).
Column What it shows
Conversation The conversation’s id, as a link.
Trace The kinds of trace it contains, as tags.
User Who the conversation was with.
Started Its first turn.
Last turn Its latest turn.
Turns How many turns it has.
Tokens Tokens used across all turns.

When nothing has been recorded, the page says No conversations yet. When tracing is off on the platform, the page says Observability is not configured instead of a list.

  1. A summary: Turns, Tokens, Started, Last turn and User.
  2. For an assistant conversation, the Transcript: each Question and Answer in order, with the Sources an answer cited, View trace beside each answer, and the verdicts recorded on each answer (see Judge an answer).
  3. The Turns table: Time, Trace, Latency and Tokens for each turn, with Search traces. Select a trace to open it in a panel beside the page.
  4. Runs of this conversation, at the top right, which opens Runs filtered to this conversation.

An assistant’s transcript comes from Olympusx AI’s own record, so it can be read even when tracing is off, or after the conversation’s traces have passed their retention. The page then shows the transcript with a note: Tracing is off, so the turns of this conversation have no traces, or The traces of this conversation could not be found.

The Recent conversations table lists the tenant’s assistant conversations, with Search conversations:

Column What it shows
Conversation The conversation’s title, or Untitled conversation, as a link.
Assistant The assistant it was with.
Started When the first question was asked.
Last turn When the last answer was given.
Answers How many answers it holds.

When there are none, the page says No conversations yet.

The Transcript: every question and answer in order, with each answer’s sources and the verdicts already recorded on it, and Score this answer beside each answer. No trace is shown or linked.

Type in Search conversations. The search runs on the server, so it reaches conversations older than the ones listed.

You need the Admin or Reviewer role.

  1. Open the conversation.
  2. Beside the answer, select Score this answer.
  3. Under How was this answer?, choose Acceptable, Wrong, Unsafe or Off policy.
  4. Optionally, write Why (optional).
  5. Select Record judgment.

The verdict appears above the answer, marked By you. A judgment cannot be changed once it is recorded, and each person records at most one per answer: once you have judged an answer, the page says You have already judged this answer instead of offering the form. An Auditor sees the verdicts and no form.

The same verdict can be given from the review queue, which lists the answers nobody has judged yet. Recorded verdicts are listed on Scores.

You need a role that reads traces (Admin, Builder or Auditor).

  1. Select View trace beside an answer, or a trace in Turns.
  2. The trace opens in a panel beside the page. Select Open full page to read it on its own page. See Traces.
Limit Value
Conversations listed The 100 most recent; search reaches older ones
Verdicts per person per answer 1, final
Note with a verdict 2,000 characters

How long conversations and traces are kept is set by your platform administrator; see Data retention. An erased person’s conversations, and the verdicts on them, are removed; see Erasure.