verify.scorecard¶
The credibility of many models in one table, verify scorecard.
evidence_extensions
¶
Get the evidence extensions of the arguments.
The extensions of the project (--project) come first, then those of
--extensions, each a reference module:attribute to an extension or to
an iterable of them.
Raises:
| Type | Description |
|---|---|
UsageError
|
for a reference which cannot be resolved, an object which is no extension, or two extensions of one name. |
scorecard_command
¶
Read the credibility records of many models, compare and qualify them.
Prints the scorecard (model, context of use, verdict, verified), the pooled
qualification (--pool) and the regressions against a baseline.
Returns:
| Type | Description |
|---|---|
int
|
0, 1 for a regression against the baseline. |
Raises:
| Type | Description |
|---|---|
UsageError
|
for records, a baseline or extensions which cannot be read. |