Conversations
Operate › Conversations shows the conversations in a tenant as one thing each, rather than as separate requests. Open one to read every turn in order, judge its answers, and, where you can read traces, open the trace behind any turn.
What the page lists depends on your role. Roles that read traces see the conversations as tracing groups them: assistant threads and agent runs. A Reviewer sees the tenant’s assistant conversations from Olympusx AI’s own record, with no traces.
Who can open it
Section titled “Who can open it”| Role | What the page shows |
|---|---|
| Admin, Builder, Auditor, platform admin | Conversations grouped from traces, each with its turns and traces. |
| Reviewer | The tenant’s assistant conversations, each as its transcript, with no traces. |
| End user | Not available. Your own conversations are in My conversations. |
What you see: Admin, Builder and Auditor
Section titled “What you see: Admin, Builder and Auditor”The list
Section titled “The list”- The page header, with the tenant picker.
- The Recent conversations table, with a search field (Search conversations).
| Column | What it shows |
|---|---|
| Conversation | The conversation’s id, as a link. |
| Trace | The kinds of trace it contains, as tags. |
| User | Who the conversation was with. |
| Started | Its first turn. |
| Last turn | Its latest turn. |
| Turns | How many turns it has. |
| Tokens | Tokens used across all turns. |
When nothing has been recorded, the page says No conversations yet. When tracing is off on the platform, the page says Observability is not configured instead of a list.
A conversation
Section titled “A conversation”- A summary: Turns, Tokens, Started, Last turn and User.
- For an assistant conversation, the Transcript: each Question and Answer in order, with the Sources an answer cited, View trace beside each answer, and the verdicts recorded on each answer (see Judge an answer).
- The Turns table: Time, Trace, Latency and Tokens for each turn, with Search traces. Select a trace to open it in a panel beside the page.
- Runs of this conversation, at the top right, which opens Runs filtered to this conversation.
An assistant’s transcript comes from Olympusx AI’s own record, so it can be read even when tracing is off, or after the conversation’s traces have passed their retention. The page then shows the transcript with a note: Tracing is off, so the turns of this conversation have no traces, or The traces of this conversation could not be found.
What you see: Reviewer
Section titled “What you see: Reviewer”The list
Section titled “The list”The Recent conversations table lists the tenant’s assistant conversations, with Search conversations:
| Column | What it shows |
|---|---|
| Conversation | The conversation’s title, or Untitled conversation, as a link. |
| Assistant | The assistant it was with. |
| Started | When the first question was asked. |
| Last turn | When the last answer was given. |
| Answers | How many answers it holds. |
When there are none, the page says No conversations yet.
A conversation
Section titled “A conversation”The Transcript: every question and answer in order, with each answer’s sources and the verdicts already recorded on it, and Score this answer beside each answer. No trace is shown or linked.
What you can do
Section titled “What you can do”Find a conversation
Section titled “Find a conversation”Type in Search conversations. The search runs on the server, so it reaches conversations older than the ones listed.
Judge an answer
Section titled “Judge an answer”You need the Admin or Reviewer role.
- Open the conversation.
- Beside the answer, select Score this answer.
- Under How was this answer?, choose Acceptable, Wrong, Unsafe or Off policy.
- Optionally, write Why (optional).
- Select Record judgment.
The verdict appears above the answer, marked By you. A judgment cannot be changed once it is recorded, and each person records at most one per answer: once you have judged an answer, the page says You have already judged this answer instead of offering the form. An Auditor sees the verdicts and no form.
The same verdict can be given from the review queue, which lists the answers nobody has judged yet. Recorded verdicts are listed on Scores.
Open the trace behind a turn
Section titled “Open the trace behind a turn”You need a role that reads traces (Admin, Builder or Auditor).
- Select View trace beside an answer, or a trace in Turns.
- The trace opens in a panel beside the page. Select Open full page to read it on its own page. See Traces.
Limits
Section titled “Limits”| Limit | Value |
|---|---|
| Conversations listed | The 100 most recent; search reaches older ones |
| Verdicts per person per answer | 1, final |
| Note with a verdict | 2,000 characters |
How long conversations and traces are kept is set by your platform administrator; see Data retention. An erased person’s conversations, and the verdicts on them, are removed; see Erasure.