ClassificationEvaluator#

class ClassificationEvaluator[source]#

Bases: Evaluator

Evaluates predictions for a set of scenes.

__init__(class_config: ClassConfig, output_uri: Optional[str] = None)[source]#
Parameters

Methods

__init__(class_config[, output_uri])

create_evaluation()

evaluate_predictions(ground_truth, predictions)

Evaluate predictions against ground truth.

evaluate_scene(scene)

Evaluate predictions from a scene's labels store.

process(scenes[, tmp_dir])

Evaluate all given scenes and save the evaluations.

__init__(class_config: ClassConfig, output_uri: Optional[str] = None)[source]#
Parameters
abstract create_evaluation() ClassificationEvaluation[source]#
Return type

ClassificationEvaluation

evaluate_predictions(ground_truth: Labels, predictions: Labels) ClassificationEvaluation[source]#

Evaluate predictions against ground truth.

Parameters
  • ground_truth (Labels) – Ground truth labels.

  • predictions (Labels) – Predictions.

Returns

The evaluation.

Return type

Any

evaluate_scene(scene: Scene) ClassificationEvaluation[source]#

Evaluate predictions from a scene’s labels store.

The predictions are evalated against ground truth labels from the scene’s label source.

Parameters

scene (Scene) – A scene with a label source and a label store.

Returns

The evaluation.

Return type

ClassificationEvaluation

process(scenes: Iterable[Scene], tmp_dir: Optional[str] = None) None[source]#

Evaluate all given scenes and save the evaluations.

Parameters
Return type

None