arize-experiment
INVOKE THIS SKILL when creating, running, or analyzing Arize experiments. Covers experiment CRUD, exporting runs, comparing results, and evaluation workflows using the ax CLI.
Best for ML teams running model eval…Works with GitHub
⌘source
- author
@github- language
- Python
★31kstars
3.6kforks
Apr 18, 2026
✦overview.md
Key Features
- ·Create, run, and analyze Arize experiments
- ·Export experiment runs for analysis
- ·Compare results across different experiments
- ·Execute evaluation workflows using ax CLI
Use Cases
- →Creating a new experiment to evaluate model performance on a specific dataset version
- →Exporting experiment runs for detailed analysis in external tools
- →Comparing results between different model versions or configurations
- →Setting up automated evaluation workflows in CI/CD pipelines
Best for
- ✓ML teams running model evaluations
- ✓Data scientists analyzing experiment results
Not ideal for
- !Teams without Arize API access
- !One-off manual evaluations without automation
FAQs
name
arize-experiment
description
INVOKE THIS SKILL when creating, running, or analyzing Arize experiments. Covers experiment CRUD, exporting runs, comparing results, and evaluation workflows using the ax CLI.
Arize Experiment Skill
Concepts
- Experiment = a named evaluation run against a specific dataset version, containing one run per example
- Experiment Run = the result of processing one dataset example -- includes the model output, optional evaluations, and optional metadata
- Dataset = a versioned collection of examples; every experiment is tied to a dataset and a specific dataset version
- Evaluation = a named metric attached to a run (e.g.,
correctness,relevance), with optional label, score, and explanation
The typical flow: export a dataset → process each example → collect outputs and evaluations → create an experiment with the runs.
Prerequisites
Proceed directly with the task — run the ax command you need. Do NOT check versions, env vars, or profiles upfront.
If an ax command fails, troubleshoot based on the error:
command not foundor version error → see references/ax-setup.md
$install
1-click copynpx skills add github/awesome-copilot --skill arize-experimentSafety assessment
★
Clarity score
How clear and easy to understand the SKILL.md instructions are, rated from 1 to 5.
3/ 5
goodMostly clear, but there are still a few confusing or poorly structured parts.
◎
Actionability score
How directly an agent can act on the SKILL.md instructions, rated from 1 to 5.
3/ 5
mediumPartially actionable with several concrete steps, but still missing important details.