arize-annotation
INVOKE THIS SKILL when creating, managing, or using annotation configs on Arize (categorical, continuous, freeform), or applying human annotations to project spans via the Python SDK. Configs are the label schema for human feedback on spans and other surfaces in the Arize UI. Triggers: annotation config, label schema, human feedback schema, bulk annotate spans, update_annotations.
Best for Teams implementing human fe…Works with GitHub
⌘source
- author
@github- language
- Python
★30kstars
3.6kforks
Apr 18, 2026
✦overview.md
Key Features
- ·Manage annotation configs for human feedback schemas
- ·Bulk annotate project spans via Python SDK
- ·Define label schemas for Arize UI surfaces
- ·Update annotations on spans programmatically
Use Cases
- →Setting up label schemas for human review in Arize UI
- →Applying human annotations to spans in bulk
- →Managing annotation configurations for datasets and experiments
Best for
- ✓Teams implementing human feedback workflows
- ✓Projects using Arize for monitoring and evaluation
Not ideal for
- !One-off manual annotation tasks
- !Non-Arize platforms
FAQs
name
arize-annotation
description
INVOKE THIS SKILL when creating, managing, or using annotation configs on Arize (categorical, continuous, freeform), or applying human annotations to project spans via the Python SDK. Configs are the label schema for human feedback on spans and other surfaces in the Arize UI. Triggers: annotation config, label schema, human feedback schema, bulk annotate spans, update_annotations.
Arize Annotation Skill
This skill focuses on annotation configs — the schema for human feedback — and on programmatically annotating project spans via the Python SDK. Human review in the Arize UI (including annotation queues, datasets, and experiments) still depends on these configs; there is no ax CLI for queues yet.
Direction: Human labeling in Arize attaches values defined by configs to spans, dataset examples, experiment-related records, and queue items in the product UI. What is documented here: ax annotation-configs and bulk span updates with ArizeClient.spans.update_annotations.
Prerequisites
Proceed directly with the task — run the ax command you need. Do NOT check versions, env vars, or profiles upfront.
If an ax command fails, troubleshoot based on the error:
command not foundor version error → see references/ax-setup.md
$install
1-click copynpx skills add github/awesome-copilot --skill arize-annotationSafety assessment
★
Clarity score
How clear and easy to understand the SKILL.md instructions are, rated from 1 to 5.
3/ 5
goodMostly clear, but there are still a few confusing or poorly structured parts.
◎
Actionability score
How directly an agent can act on the SKILL.md instructions, rated from 1 to 5.
3/ 5
mediumPartially actionable with several concrete steps, but still missing important details.