org.lemurproject.ireval

Class SetRetrievalComparator

java.lang.Object

org.lemurproject.ireval.SetRetrievalComparator

public class SetRetrievalComparator
extends Object

Author:

Trevor Strohman, Jonathon Hare (jsh2@ecs.soton.ac.uk)

Constructor Summary

Constructors

Constructor and Description
SetRetrievalComparator(Map<String,Double> baseline, Map<String,Double> treatment) Creates a new instance of SetRetrievalComparator

Method Summary

Methods

Modifier and Type	Method and Description
int	countBaselineBetter()
int	countEqual()
int	countTreatmentBetter()
double	meanBaselineMetric()
double	meanTreatmentMetric()
double	pairedTTest()
double	randomizedTest()
double	signTest()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SetRetrievalComparator

public SetRetrievalComparator(Map<String,Double> baseline,
                      Map<String,Double> treatment)

Creates a new instance of SetRetrievalComparator

Parameters:

baseline -

treatment -

Method Detail

meanBaselineMetric

public double meanBaselineMetric()

Returns:

mean baseline metric

meanTreatmentMetric

public double meanTreatmentMetric()

Returns:

mean treatment metric

countTreatmentBetter

public int countTreatmentBetter()

Returns:

number of times treatment is better than baseline

countBaselineBetter

public int countBaselineBetter()

Returns:

number of times baseline is better than treatment

countEqual

public int countEqual()

Returns:

number of times baseline and treatment are equal

pairedTTest

public double pairedTTest()

Returns:

result of T-test between baseline and treatment

signTest

public double signTest()

Returns:

result of sign test between baseline and treatment

randomizedTest

public double randomizedTest()

Returns:

result of randomized test between baseline and treatment