> ## Knowledge Base Index
> Fetch the complete knowledge base index at: https://help.crisp.chat/sitemap.xml
> Use this file to discover available pages before exploring further.
> Pure-Markdown content can be obtained by appending a '.md' suffix to the content URLs listed in the sitemap (without the trailing slash).

# How to monitor and debug Hugo AI Agent conversations with Observability

*This article explains how to use Hugo Observability to understand, monitor, and debug individual AI Agent conversations.*

[Hugo AI Agent](https://hugo.ai/en/) can answer customers, use support resources, call tools, trigger workflows, and escalate conversations when needed.

Hugo Observability gives you a detailed view of what happened during each conversation. You can review the steps processed before Hugo answered, inspect the tools and models used, identify errors, and understand why a conversation was handled, escalated, or failed.

||| **Hugo Observability is a premium feature available exclusively on the Crisp Plus plan.** If your workspace is on [another plan](https://crisp.chat/en/pricing/), you will need to upgrade to Plus to access conversation traces and debugging tools.

__In this guide, you will learn how to:__
* [Understand Hugo Observability](#1-what-is-hugo-observability) → see what happened during individual AI Agent conversations
* [Know when to use Observability](#1-when-should-you-use-observability) → investigate unexpected answers, errors, and escalations
* [Open the Observability view](#1-open-the-observability-view) → access it from your AI Agent setup
* [Find a conversation to inspect](#1-find-the-conversation-you-want-to-inspect) → filter conversations by outcome
* [Read a conversation trace](#1-read-a-conversation-trace) → follow the steps processed by Hugo
* [Understand conversation metrics](#1-understand-the-conversation-metrics) → review tools, steps, and reasoning time
* [Review models, tools, inputs, and outputs](#1-review-models-tools-inputs-and-outputs) → understand which resources Hugo used
* [Investigate failed or escalated conversations](#1-investigate-failed-or-escalated-conversations) → identify where the conversation needs improvement
* [Open the original conversation](#1-open-the-original-conversation) → return to the Crisp Inbox with the full context
* [Export Observability traces](#1-export-observability-traces) → share or investigate conversation traces
* [Understand AI Suggestions vs Analytics vs Observability](#1-ai-suggestions-vs-analytics-vs-observability) → choose the right tool for your analysis
* [Follow Observability best practices](#1-best-practices) → turn traces into useful improvements
---

# ${color}[#0080dd](What is Hugo Observability)

Hugo Observability is a conversation-level monitoring view for your AI Agent.

It shows how a specific customer conversation was processed by Hugo or by a Workflow before the final outcome.

Instead of only seeing the customer message and Hugo's answer, you can inspect the steps that happened between them.

__Depending on the conversation, Observability can show:__
* The tools Hugo used
* The model that generated an answer
* Searches performed before answering
* Tool inputs and returned results
* Authentication steps
* Guardrails applied to the response
* Processing and reasoning times
* Errors generated during the conversation
* Whether the conversation was handled, escalated, processed by a Workflow, or failed

This helps you understand not only **what Hugo answered**, but also **how the conversation reached that result**.

|| Observability is designed to inspect individual conversations. To measure Hugo's overall performance and conversation outcomes, use [**Hugo Analytics**](https://help.crisp.chat/en/article/how-to-use-hugo-ai-analytics-6ymdxs/). To identify recurring knowledge gaps across multiple customer conversations and receive concrete content recommendations, use [**Hugo AI Suggestions**](https://help.crisp.chat/en/article/how-to-use-hugo-ai-suggestions-to-improve-your-ai-agent-ho0flf/).
---

# ${color}[#0080dd](When should you use Observability)

Use Observability when you need to understand the behavior of a specific AI Agent conversation.

#### ${color}[#445055](Investigate an unexpected answer)

If Hugo gives an incomplete, inaccurate, or surprising answer, review the trace to see which sources, tools, and model were used before the response was generated.

#### ${color}[#445055](Check whether a tool was called)

When Hugo should retrieve customer information or perform an action, Observability shows whether the expected tool was called and what it returned.

This can be useful when investigating [Hugo Integrations](https://help.crisp.chat/en/article/how-to-use-hugo-integrations-6z9yhh/), [MCP tools](https://help.crisp.chat/en/article/how-to-build-mcp-integrations-with-hugo-tlrqmn/), or [Widget Tools](https://help.crisp.chat/en/article/how-to-use-hugo-widget-tools-to-guide-customers-inside-your-product-1c6aqpe/).

#### ${color}[#445055](Understand an escalation)

Review the conversation steps to understand what Hugo tried before handing the customer over to your team.

You can then check whether your [Instructions](https://help.crisp.chat/en/article/how-to-write-hugo-instructions-for-ai-agent-and-copilot-1qc131v/), Routing rules, or [escalation setup](https://help.crisp.chat/en/article/how-to-configure-escalation-with-hugo-ai-agent-sqbm34/) should be adjusted.

#### ${color}[#445055](Diagnose an error)

If a conversation fails, Observability displays the error inside the trace and helps you identify which step or tool caused it.

#### ${color}[#445055](Investigate a slow conversation)

Review processing times to see whether the delay came from Hugo's reasoning, a search, an external tool, or another step in the conversation.

#### ${color}[#445055](Share a technical example)

Export the trace when you need to share a reproducible conversation with your technical team or Crisp support.
---

# ${color}[#0080dd](Open the Observability view)

To access Hugo Observability:

1. Open [**Crisp**](https://app.crisp.chat)
2. Select **AI Agent** from the main menu
3. Go to **Evaluate → Observability**

![Open Hugo AI Agent Observability in Crisp](https://storage.crisp.chat/users/helpdesk/website/-/8/7/a/e/87ae2703583ac800/hugo-ai-agent-observability-da_1szlk2n.png =1000x602)

The view is divided into two main areas:

* **Conversation list** → find and filter conversations processed by Hugo or Workflows
* **Conversation trace** → inspect the detailed steps for the selected conversation

Select a conversation from the list to open its trace.
---

# ${color}[#0080dd](Find the conversation you want to inspect)

The Observability list contains recent conversations processed through your AI Agent setup.

You can use the status filter to focus on a specific outcome.

![Filter Hugo Observability conversations by status](https://storage.crisp.chat/users/helpdesk/website/-/8/7/a/e/87ae2703583ac800/hugo-observability-conversatio_1bzm7wt.png =550x608)

__Available filters include:__
* **All** → show all available conversations
* **Handled** → conversations completed by Hugo
* **Workflow** → conversations processed through a Workflow
* **Escalated** → conversations transferred to a human
* **Failed** → conversations where an error prevented the expected result

Each conversation preview can also display information such as:

* The latest customer message
* The conversation outcome
* The number of tools used
* The total processing time
* When the conversation happened

Start with **Failed** or **Escalated** when investigating a recurring problem.
---

# ${color}[#0080dd](Read a conversation trace)

A conversation trace displays the customer messages, Hugo's answers, and the steps processed between them.

The trace follows the conversation chronologically, so you can review what happened before each answer.

![Review a Hugo AI Agent conversation trace](https://storage.crisp.chat/users/helpdesk/website/-/8/7/a/e/87ae2703583ac800/hugo-ai-agent-conversation-tra_1hckiz4.png =600x594)

__Depending on the conversation, a trace can include:__
* **Agent Reasoning** → the reasoning stage processed before Hugo continues
* **Tool call** → an action or data request sent to an integration
* **Tool result** → the information returned by that tool
* **Search** → a search performed across available resources
* **Guardrails** → checks applied before a response is generated
* **Authentication** → verification required before accessing protected data or actions
* **Workflow steps** → actions processed by a Crisp Workflow
* **Errors** → problems encountered while processing a step
* **Hugo answers** → the customer-facing messages generated by the AI Agent

Click a step to expand it and inspect the available details.

| The exact steps displayed depend on what Hugo used during that conversation. A simple answer may contain fewer steps than a conversation involving tools, authentication, or several searches.
---

# ${color}[#0080dd](Understand the conversation metrics)

At the top of a selected conversation, Observability displays a quick overview of its processing activity.

__The main metrics include:__
* **Tools used** → the number of tool calls made during the conversation
* **Steps processed** → the number of processing steps completed by Hugo
* **Average reasoning time** → the average time spent on reasoning stages

These metrics help you understand the complexity of a conversation.

For example:

* A conversation using several tools may require data from multiple systems
* A high number of steps may indicate a more complex customer request
* A slow tool call may explain why the customer waited longer for an answer
* A long trace may reveal unnecessary or repeated actions

These metrics should be interpreted in context. A higher number of steps does not automatically mean that something went wrong.
---

# ${color}[#0080dd](Review models, tools, inputs, and outputs)

Observability lets you inspect the resources Hugo used to answer or perform an action.

#### ${color}[#445055](Review the AI model)

The model name is displayed under answers generated by Hugo.

![Review the AI model used by Hugo](https://storage.crisp.chat/users/helpdesk/website/-/8/7/a/e/87ae2703583ac800/hugo-observability-search-tool_1yagc0v.png =600x565)

This helps you confirm which model generated a specific response.

To learn how models affect quality, speed, hosting, and AI credit usage, read [**How to choose and configure Hugo's AI Model**](https://help.crisp.chat/en/article/how-to-choose-and-configure-hugos-ai-model-1m4mm57/).

#### ${color}[#445055](Review a tool call)

Open a **Tool call** step to inspect the action performed by Hugo.

The available details can include:

* Tool name
* Tool provider
* Execution time
* Input parameters
* Returned output
* Request and response logs
* Success or error status

This helps you verify whether the expected information was sent to the tool and whether the result returned to Hugo was correct.

#### ${color}[#445055](Review authentication steps)

When an action requires customer verification, the trace can display the authentication step and its outcome.

This is useful when Hugo needs to access private account, billing, or order information before completing a request.

|| Tool inputs and outputs may contain customer or account information. Only share exported traces with people who are authorized to access that data.
---

# ${color}[#0080dd](Investigate failed or escalated conversations)

Observability helps you move from a conversation outcome to the step that caused it.

#### ${color}[#445055](Investigate failed conversations)

Open a conversation marked as **Failed**, then review the trace from top to bottom.

__Check:__
* Which step contains the error
* The error message displayed
* Which tool or provider was involved
* The parameters sent to the tool
* Whether the input matches the expected format
* Whether a valid result was returned
* Whether the external service was available

Once you identify the failing step, you can review the related integration, tool configuration, or Workflow.

For a broader diagnostic checklist, read [**Troubleshooting and common questions about Hugo AI Agent**](https://help.crisp.chat/en/article/troubleshooting-common-questions-about-hugo-ai-agent-38rrji/).

#### ${color}[#445055](Investigate escalated conversations)

Open a conversation marked as **Escalated** and review what happened before the handover.

__Check:__
* What the customer requested
* Which searches or tools Hugo used
* Whether information was missing
* Whether an instruction or routing rule required escalation
* Whether the customer explicitly requested a human
* Whether a tool failed before the escalation

An escalation is not always a failure. Hugo may be correctly following your configuration or handing over a request that requires human judgment.
---

# ${color}[#0080dd](Open the original conversation)

Observability gives you the technical trace, but you may also need the complete support context from the Inbox.

Click **Go to conversation** from the selected trace.

![Open the original Crisp conversation from Observability](https://storage.crisp.chat/users/helpdesk/website/-/8/7/a/e/87ae2703583ac800/hugo-observability-go-to-conve_m32qix.png =900x257)

The conversation opens in the Crisp Inbox, where you can:

* Read the full customer history
* Review private notes
* Check contact and account information
* See who handled the conversation
* Continue the investigation with your support team
* Reply to the customer when needed

Use Observability to understand the AI processing, then return to the Inbox when you need the broader customer context.
---

# ${color}[#0080dd](Export Observability traces)

You can export Observability data when you need to investigate or share a conversation outside the view.

#### ${color}[#445055](Export one conversation)

Open the conversation you want to inspect, then click **Export Trace**.

This is useful when you need to:

* Share a specific problem with a developer
* Send a detailed example to Crisp support
* Keep a trace of an incident
* Compare the same issue before and after changing your setup

#### ${color}[#445055](Export multiple traces)

Click **Export All** from the conversation list to export the available traces.

Before sharing an exported trace, review whether it contains customer information, tool inputs, or private account data.
---

# ${color}[#0080dd](AI Suggestions vs Analytics vs Observability)

AI Suggestions, Analytics, and Observability all help you improve Hugo, but they work at different levels of your customer support activity.

| Feature | Best used for |
| ---- |
| **Observability** | Understanding and debugging what happened inside one specific AI Agent conversation |
| **Analytics** | Measuring overall AI Agent performance, activity, outcomes, and conversation trends |
| **AI Suggestions** | Identifying concrete knowledge improvements from multiple customer conversations |

For example:

* Use **Analytics** to identify a broader trend, such as an increase in escalations or a recurring conversation topic
* Use **Observability** to inspect specific conversations behind that trend and understand what Hugo did
* Use **AI Suggestions** to identify missing or outdated knowledge that could be improved based on recurring customer questions

These tools can complement each other throughout your AI support workflow.

**Analytics** helps you identify **what is happening** across your support activity. **Observability** helps you understand **why it happened** inside a specific conversation. **AI Suggestions** helps you identify **what knowledge could be improved next** based on patterns across customer conversations.

To learn more, read [**How to use Hugo Analytics to improve your AI Agent**](https://help.crisp.chat/en/article/how-to-use-hugo-ai-analytics-6ymdxs/) and [**How to use Hugo AI Suggestions to improve your AI Agent**](https://help.crisp.chat/en/article/how-to-use-hugo-ai-suggestions-to-improve-your-ai-agent-ho0flf/).
---

# ${color}[#0080dd](Best practices)

Observability is most useful when you use traces to identify a specific improvement.

#### ${color}[#445055](Start with failed and escalated conversations)

These outcomes often provide the clearest opportunities to improve a tool, Workflow, instruction, or escalation rule.

#### ${color}[#445055](Compare several conversations)

Do not change your AI Agent setup based on one unusual conversation.

Review several examples to confirm that the issue is recurring before making broader changes.

When you want to identify recurring knowledge gaps automatically across a larger set of conversations, use [**Hugo AI Suggestions**](https://help.crisp.chat/en/article/how-to-use-hugo-ai-suggestions-to-improve-your-ai-agent-ho0flf/) instead.

#### ${color}[#445055](Identify the failing layer)

An unexpected answer does not always come from the AI model.

Check whether the issue comes from:

* Missing or outdated training resources
* An unclear Instruction
* A Routing or escalation rule
* A failed external tool
* An incorrect tool input
* An unavailable integration
* The selected AI model

#### ${color}[#445055](Review inputs before blaming outputs)

When a tool returns an incorrect result, check the parameters sent by Hugo and the data returned by the provider.

The final answer may reflect an incomplete or unexpected tool result.

#### ${color}[#445055](Export traces before reporting bugs)

An exported trace gives technical teams more context than a screenshot of the final customer answer alone.

#### ${color}[#445055](Protect customer data)

Traces can contain messages, customer details, tool parameters, authentication results, or returned account information.

Review exports before sharing them outside your authorized team.
---

# ${color}[#0080dd](Frequently Asked Questions)

*Still have questions which were not covered in this article? Here is a collection of the most frequently asked questions on this topic.*

###### ${color}[#F08820](Can I inspect the tools Hugo called?)

Yes. Tool call steps can display information such as the tool name, provider, input, output, execution time, logs, and status.

The exact details depend on the tool involved.

###### ${color}[#F08820](Can I see errors directly in Observability?)

Yes. When an error occurs during the conversation, it can be displayed directly inside the relevant trace step.

Use the error message, tool input, and returned output to identify what needs to be corrected.

###### ${color}[#F08820](What should I do after finding an issue?)

Identify which part of the setup caused the behavior before making changes.

Depending on the trace, you may need to update your [training data](https://help.crisp.chat/en/article/how-to-train-hugo-ai-agent-on-your-data-ijkdrl/), [Instructions](https://help.crisp.chat/en/article/how-to-write-hugo-instructions-for-ai-agent-and-copilot-1qc131v/), [Routing rules](https://help.crisp.chat/en/article/how-does-hugo-routing-work-47o06k/), [model settings](https://help.crisp.chat/en/article/how-to-choose-and-configure-hugos-ai-model-1m4mm57/), [Workflow](https://help.crisp.chat/en/article/how-to-start-hugo-from-workflows-1i1jeof/), or [connected tool](https://help.crisp.chat/en/article/how-to-build-mcp-integrations-with-hugo-tlrqmn/).

If the same knowledge issue appears across multiple conversations, use [**Hugo AI Suggestions**](https://help.crisp.chat/en/article/how-to-use-hugo-ai-suggestions-to-improve-your-ai-agent-ho0flf/) to identify recurring gaps and review suggested content improvements.