aip_sdk.RowCoverage
aip_sdk.RowCoverage(total_rows: int, answered_rows: int, unanswered_rows: int, coverage: float, unanswered_breakdown: list[UnansweredRows] = list[UnansweredRows](), scores_exclude_unanswered: bool = True)
How much of the dataset the system under test actually answered.
Every score in metrics is computed over answered_rows, not total_rows: a row
the endpoint refused carries no response to evaluate, so it is left out of the metric
rather than scored as a failure. Read coverage alongside any score — a run at 0.38
coverage reports a number about 38% of the dataset.
Attributes
total_rowsint: Rows in the dataset the run was given.answered_rowsint: Rows the endpoint answered, and the denominator of every metric.unanswered_rowsint: Rows the endpoint never answered, excluded from every metric.coveragefloat:answered_rows / total_rows, between 0.0 and 1.0.unanswered_breakdownlist[UnansweredRows]: Why the unanswered rows went unanswered, largest group first. Empty when every row was answered.scores_exclude_unansweredbool: Whether this run's scores really do leave the unanswered rows out.Falsefor a run scored before the platform excluded them, whose metrics still count every refused row as a failure — read its scores as coveringtotal_rows, and re-run it for figures that coveranswered_rows.
aip_sdk.RowCoverage.answered_rows
aip_sdk.RowCoverage.answered_rows: int
No docstring is defined in the source.
aip_sdk.RowCoverage.coverage
aip_sdk.RowCoverage.coverage: float
No docstring is defined in the source.
aip_sdk.RowCoverage.scores_exclude_unanswered
aip_sdk.RowCoverage.scores_exclude_unanswered: bool = True
No docstring is defined in the source.
aip_sdk.RowCoverage.total_rows
aip_sdk.RowCoverage.total_rows: int
No docstring is defined in the source.
aip_sdk.RowCoverage.unanswered_breakdown
aip_sdk.RowCoverage.unanswered_breakdown: list[UnansweredRows] = field(default_factory=list[UnansweredRows])
No docstring is defined in the source.
aip_sdk.RowCoverage.unanswered_rows
aip_sdk.RowCoverage.unanswered_rows: int
No docstring is defined in the source.