aip_sdk.Telemetry
aip_sdk.Telemetry(name: str, mean: float, std: float, count: int)
Aggregated per-column SUT call telemetry (HTTP status, retry count, time-to-first-byte).
Reports how the call to the system under test behaved, not how well it scored — there is
no pass_rate, since "passing" doesn't apply to an HTTP status code the way it applies
to an evaluation score.
Attributes
namestr: The telemetry column this summarises (e.g."ev_retry_count","ev_ttfb_ms").meanfloat: Mean value across every row where this column was recorded.float("nan")whencountis 0 — seeMetric.meanfor why NaN, not 0.stdfloat: Standard deviation across the same rows.nanwhenevermeanis, and also atcount == 1even thoughmeanis real then — seeMetric.std.countint: Number of rows where this column was recorded (non-null).
aip_sdk.Telemetry.count
aip_sdk.Telemetry.count: int
No docstring is defined in the source.
aip_sdk.Telemetry.mean
aip_sdk.Telemetry.mean: float
No docstring is defined in the source.
aip_sdk.Telemetry.name
aip_sdk.Telemetry.name: str
No docstring is defined in the source.
aip_sdk.Telemetry.std
aip_sdk.Telemetry.std: float
No docstring is defined in the source.