dctools.metrics.evaluator

Metrics evaluator module for distributed evaluation.

Functions

compute_metric(entry, pred_source_config, ...)	Compute metrics for a single prediction-reference pair entry.
worker_memory_cleanup()	Manual memory cleanup to be run on workers.

Classes

Evaluator(dataset_manager, metrics, ...[, ...])

Class to evaluate metrics on datasets.