Skip to main content

aip_sdk.MetricUnavailableReason

aip_sdk.MetricUnavailableReason

Why a trace metric cannot score a partition.

The first four are properties of the metric against the occurrence rows it would score; the next four are structural — the partition's granularity, the span kinds its occurrences carry, or (REQUIRED_SHAPE_UNSUPPORTED) the topology of the traces it resolves to, e.g. an orchestrator delegating to subagent(s). PARTITION_HAS_NO_OCCURRENCES is a property of the selector as a whole and answers "why is everything unavailable" for an over-narrowed partition. OP_NOT_DEPLOYED is a property of the environment: the metric exists and fits, but its scoring function is not running here, so a run would fail. Ask whoever operates your platform to deploy it.

AMBIGUOUS_TRACE_GROUND_TRUTH is a property of the ground truth attached to the version. agent.step_accuracy and agent.tool_selection_accuracy fall back to a session's pooled ground truth when a trace carries no annotation of its own — correct for a single-trace session, but a multi-trace one has no single trace whose steps or tool calls should be compared against a trajectory authored for the whole conversation, so both metrics reject that occurrence outright at scoring time rather than silently mis-scoring it (a FAILED row, not a wrong number). Fix by attaching trace-scoped ground truth for the affected traces, or by scoring the metric on a SESSION partition instead.

Reported only when every occurrence a TRACE partition selects would hit that fallback: a partition mixing some traces that carry their own ground truth with others that would fall back to the pooled value still reports available=True — the pooled-fallback traces are still individually rejected if you run it (each becomes a FAILED row, not a wrong score), so available=True never hides a bad number; a mixed partition just doesn't warn you in advance which rows will fail.

aip_sdk.MetricUnavailableReason.AMBIGUOUS_TRACE_GROUND_TRUTH​

aip_sdk.MetricUnavailableReason.AMBIGUOUS_TRACE_GROUND_TRUTH = 'AmbiguousTraceGroundTruth'

No docstring is defined in the source.

aip_sdk.MetricUnavailableReason.OP_CONTRACT_INVALID​

aip_sdk.MetricUnavailableReason.OP_CONTRACT_INVALID = 'OpContractInvalid'

No docstring is defined in the source.

aip_sdk.MetricUnavailableReason.OP_MISSING_COLUMNS​

aip_sdk.MetricUnavailableReason.OP_MISSING_COLUMNS = 'OpMissingColumns'

No docstring is defined in the source.

aip_sdk.MetricUnavailableReason.OP_NOT_DEPLOYED​

aip_sdk.MetricUnavailableReason.OP_NOT_DEPLOYED = 'OpNotDeployed'

No docstring is defined in the source.

aip_sdk.MetricUnavailableReason.OP_NOT_FOUND​

aip_sdk.MetricUnavailableReason.OP_NOT_FOUND = 'OpNotFound'

No docstring is defined in the source.

aip_sdk.MetricUnavailableReason.OP_SCHEMA_INCOMPATIBLE​

aip_sdk.MetricUnavailableReason.OP_SCHEMA_INCOMPATIBLE = 'OpSchemaIncompatible'

No docstring is defined in the source.

aip_sdk.MetricUnavailableReason.PARTITION_HAS_NO_OCCURRENCES​

aip_sdk.MetricUnavailableReason.PARTITION_HAS_NO_OCCURRENCES = 'PartitionHasNoOccurrences'

No docstring is defined in the source.

aip_sdk.MetricUnavailableReason.PARTITION_TYPE_UNSUPPORTED​

aip_sdk.MetricUnavailableReason.PARTITION_TYPE_UNSUPPORTED = 'PartitionTypeUnsupported'

No docstring is defined in the source.

aip_sdk.MetricUnavailableReason.REQUIRED_KINDS_ABSENT​

aip_sdk.MetricUnavailableReason.REQUIRED_KINDS_ABSENT = 'RequiredKindsAbsent'

No docstring is defined in the source.

aip_sdk.MetricUnavailableReason.REQUIRED_SHAPE_UNSUPPORTED​

aip_sdk.MetricUnavailableReason.REQUIRED_SHAPE_UNSUPPORTED = 'RequiredShapeUnsupported'

No docstring is defined in the source.

aip_sdk.MetricUnavailableReason.SCORER_CONTRACT_MISMATCH​

aip_sdk.MetricUnavailableReason.SCORER_CONTRACT_MISMATCH = 'ScorerContractMismatch'

No docstring is defined in the source.

aip_sdk.MetricUnavailableReason.TARGET_KIND_MISMATCH​

aip_sdk.MetricUnavailableReason.TARGET_KIND_MISMATCH = 'TargetKindMismatch'

No docstring is defined in the source.