org.openimaj.experiment.validation

Class ValidationRunner

java.lang.Object

org.openimaj.experiment.validation.ValidationRunner

public class ValidationRunner
extends Object

Utility methods for performing validation and cross validation.

Author:

Jonathon Hare (jsh2@ecs.soton.ac.uk)

Method Summary

Methods

Modifier and Type	Method and Description
static <DATASET extends Dataset<?>,ANALYSIS_RESULT,AGGREGATE_ANALYSIS_RESULT extends AnalysisResult> AGGREGATE_ANALYSIS_RESULT	run(ResultAggregator<ANALYSIS_RESULT,AGGREGATE_ANALYSIS_RESULT> aggregator, DATASET dataset, CrossValidator<DATASET> cv, ValidationOperation<DATASET,ANALYSIS_RESULT> round) Perform cross validation using the given cross validation scheme on the given data.
static <DATASET extends Dataset<?>,ANALYSIS_RESULT,AGGREGATE_ANALYSIS_RESULT extends AnalysisResult> AGGREGATE_ANALYSIS_RESULT	run(ResultAggregator<ANALYSIS_RESULT,AGGREGATE_ANALYSIS_RESULT> aggregator, DATASET dataset, CrossValidator<DATASET> cv, ValidationOperation<DATASET,ANALYSIS_RESULT> round, ThreadPoolExecutor pool) Perform cross validation using the given cross validation scheme on the given data.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

run

public static <DATASET extends Dataset<?>,ANALYSIS_RESULT,AGGREGATE_ANALYSIS_RESULT extends AnalysisResult> AGGREGATE_ANALYSIS_RESULT run(ResultAggregator<ANALYSIS_RESULT,AGGREGATE_ANALYSIS_RESULT> aggregator,
                                                                                                                          DATASET dataset,
                                                                                                                          CrossValidator<DATASET> cv,
                                                                                                                          ValidationOperation<DATASET,ANALYSIS_RESULT> round)

Perform cross validation using the given cross validation scheme on the given data. The results of operation from each round are aggregated by the given results aggregator.

Rounds of the validation are performed in parallel using threads from the GlobalExecutorPool.

Type Parameters:

DATASET - The type of the dataset

ANALYSIS_RESULT - The type of the analysis result from each round

AGGREGATE_ANALYSIS_RESULT - The type of the aggregated analysis result

Parameters:

aggregator - the results aggregator

dataset - the dataset

cv - the cross-validation scheme

round - the operation to perform in each round

Returns:

the aggregated analysis result from all rounds

run

public static <DATASET extends Dataset<?>,ANALYSIS_RESULT,AGGREGATE_ANALYSIS_RESULT extends AnalysisResult> AGGREGATE_ANALYSIS_RESULT run(ResultAggregator<ANALYSIS_RESULT,AGGREGATE_ANALYSIS_RESULT> aggregator,
                                                                                                                          DATASET dataset,
                                                                                                                          CrossValidator<DATASET> cv,
                                                                                                                          ValidationOperation<DATASET,ANALYSIS_RESULT> round,
                                                                                                                          ThreadPoolExecutor pool)

Perform cross validation using the given cross validation scheme on the given data. The results of operation from each round are aggregated by the given results aggregator.

Rounds of the validation can be performed in parallel, using the available threads in the given pool.

Type Parameters:

DATASET - The type of the dataset

ANALYSIS_RESULT - The type of the analysis result from each round

AGGREGATE_ANALYSIS_RESULT - The type of the aggregated analysis result

Parameters:

aggregator - the results aggregator

dataset - the dataset

cv - the cross-validation scheme

round - the operation to perform in each round

pool - a thread-pool for parallel processing

Returns:

the aggregated analysis result from all rounds