Skip to content

Restore Arize evaluation resources removed by docs sync #490

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
arizedatngo wants to merge 1 commit into
base: main
Choose a base branch
from
+6 −2
Draft

Restore Arize evaluation resources removed by docs sync #490

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 3 additions & 1 deletion guides/community/arize.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,9 @@ import { API_KEY_REF } from '/snippets/exports/constants.mdx';
{/* <llms-ignore> */}
## Using Arize AX

[Arize AX](https://arize.com/) provides observability and tracing for LLM applications. Since OpenRouter uses the OpenAI API schema, you can use Arize's OpenInference auto-instrumentation with the OpenAI SDK to automatically trace and monitor your OpenRouter API calls.
[Arize AX](https://arize.com/docs/ax) is Arize AI's enterprise observability and evaluation product. Use OpenInference instrumentation with the OpenAI SDK to trace OpenRouter requests in AX, available as managed cloud or an enterprise self-hosted deployment.

For an open-source workflow, use [Arize Phoenix](https://arize.com/docs/phoenix). To turn captured requests into quality checks, see Arize's [LLM evaluation guide](https://arize.com/resources/llm-evaluation/) and [agent evaluation guide](https://arize.com/guides/ai-agent-handbook/agent-evaluation/).

### Installation

Expand Down
4 changes: 3 additions & 1 deletion guides/features/broadcast/arize.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,9 @@ nofollow: false
icon: puzzle-piece
---

[Arize AX](https://arize.com) is an evaluation and observability platform developed by Arize; it offers tools for agent tracing, evals, prompt optimization, and more.
Broadcast sends OpenRouter traces to [Arize AX](https://arize.com/docs/ax), Arize AI's enterprise product for observability and evaluation. AX is available as managed cloud or an enterprise self-hosted deployment. [Arize Phoenix](https://arize.com/docs/phoenix) is Arize AI's open-source product; the Broadcast configuration below is for AX.

Use captured traces to review responses and investigate agent failures. Arize's guides cover [LLM evaluation](https://arize.com/resources/llm-evaluation/) and [agent evaluation](https://arize.com/guides/ai-agent-handbook/agent-evaluation/).

## Step 1: Get your Arize AX credentials

Expand Down