Uses of Class
de.uni_mannheim.informatik.dws.melt.matching_eval.ExecutionResult
Package
Description
-
Uses of ExecutionResult in de.uni_mannheim.informatik.dws.melt.matching_eval
Modifier and TypeFieldDescriptionstatic final com.googlecode.cqengine.attribute.Attribute<ExecutionResult,
String> ExecutionResult.MATCHER
This method allows the MATCHER to be an index within a collection.private com.googlecode.cqengine.index.hash.HashIndex<String,
ExecutionResult> ExecutionResultSet.matcherIndex
static final com.googlecode.cqengine.attribute.Attribute<ExecutionResult,
Set<Refiner>> ExecutionResult.REFINEMENT_SET
This method allows REFINEMENT_SET to be an index within a collection.private com.googlecode.cqengine.index.hash.HashIndex<Set<Refiner>,
ExecutionResult> ExecutionResultSet.refinementSetIndex
static final com.googlecode.cqengine.attribute.Attribute<ExecutionResult,
TestCase> ExecutionResult.TEST_CASE
This method allows the TEST_CASE to be an index within a collection.private com.googlecode.cqengine.index.hash.HashIndex<TestCase,
ExecutionResult> ExecutionResultSet.testCaseIndex
static final com.googlecode.cqengine.attribute.Attribute<ExecutionResult,
Track> ExecutionResult.TRACK
This method allows the TRACK to be an index within a collection.private com.googlecode.cqengine.index.hash.HashIndex<Track,
ExecutionResult> ExecutionResultSet.trackIndex
Modifier and TypeMethodDescriptionExecutionRunner.call()
Get a specificExecutionResult
which fulfills the specified parameters (testCase, matcherName) from the ExecutionResultSet.ExecutionResultSet.get
(ExecutionResult basisResult, Refiner... refinements) ExecutionResultSet.getFirstResult()
Returns the first execution result in this resultSet.static ExecutionResult
ExecutionRunner.runMatcher
(TestCase testCase, Object matcher, String matcherName) Run an individual matcher on an individual test case.static ExecutionResult
ExecutionRunner.runMatcher
(TestCase testCase, Object matcher, String matcherName, Object inputAlignment, Object parameters) Run an individual matcher on an individual test case.static ExecutionResult
Executor.runMatcherOnTop
(ExecutionResult oldResult, Object newMatcher, String newMatcherName) Runs a matcher on top of another.static ExecutionResult
Run a single test case with one matcher.static ExecutionResult
Run a single test case with one matcher.protected ExecutionResult
ExecutorSeals.runUnzippedMatcher
(TestCase testCase, File matcherDirectory) Evaluate a single matcher using the local SEALS client.protected ExecutionResult
ExecutorSeals.runUnzippedMatcher
(TestCase testCase, File matcherDirectory, String matcherName) Evaluate a single matcher using the local SEALS client.Modifier and TypeMethodDescriptionExecutionResultSet.getGroup
(com.googlecode.cqengine.resultset.ResultSet<ExecutionResult> basisResults, Refiner... refinements) static Comparator<ExecutionResult>
ExecutionResult.getMatcherNameComparator()
Returns a comparator that can be used to sort multiple ExecutionResults by matcher name.ExecutionResultSet.getUnrefinedResults()
private static com.googlecode.cqengine.query.Query<ExecutionResult>
private static com.googlecode.cqengine.query.Query<ExecutionResult>
private static com.googlecode.cqengine.query.Query<ExecutionResult>
private static com.googlecode.cqengine.query.Query<ExecutionResult>
private static com.googlecode.cqengine.query.Query<ExecutionResult>
private static com.googlecode.cqengine.query.Query<ExecutionResult>
private static com.googlecode.cqengine.query.Query<ExecutionResult>
private static com.googlecode.cqengine.query.Query<ExecutionResult>
private static com.googlecode.cqengine.query.Query<ExecutionResult>
private static com.googlecode.cqengine.query.Query<ExecutionResult>
Modifier and TypeMethodDescriptionExecutionResultSet.get
(ExecutionResult basisResult, Refiner... refinements) static ExecutionResult
Executor.runMatcherOnTop
(ExecutionResult oldResult, Object newMatcher, String newMatcherName) Runs a matcher on top of another.static ExecutionResultSet
Executor.runMatcherOnTop
(ExecutionResult oldResult, Map<String, Object> newMatchers) Runs a matcher on top of another.Modifier and TypeMethodDescriptionExecutionResultSet.getGroup
(com.googlecode.cqengine.resultset.ResultSet<ExecutionResult> basisResults, Refiner... refinements) ModifierConstructorDescriptionExecutionResult
(ExecutionResult base, Alignment systemAlignment, Alignment referenceAlignment, Refiner refinement) Copies all members except the mappings from the given execution result (like a copy constructor). -
Uses of ExecutionResult in de.uni_mannheim.informatik.dws.melt.matching_eval.evaluator
Modifier and TypeMethodDescriptionEvaluatorRelationTypePrediction.getConfusionMap
(ExecutionResult r) protected File
Evaluator.getResultsDirectoryTrackTestcaseMatcher
(File baseDirectory, ExecutionResult executionResult) Given a base directory and anExecutionResult
, the target directory will be returned to which results can be persisted.private void
EvaluatorRelationTypePrediction.printCM
(ExecutionResult r, ConfusionMatrix cm, String name, String closure, org.apache.commons.csv.CSVPrinter printer) private void
EvaluatorRank.runMetricAndPrintToFile
(RankingMetric[] metrics, ExecutionResult executionResult, String refinerString, org.apache.commons.csv.CSVPrinter printer) Runs the metric on the given result and prints a line to the CSV file.private void
EvaluatorRankGroup.runMetricAndPrintToFile
(RankingMetricGroup[] metrics, ExecutionResult executionResult, String refinerString, org.apache.commons.csv.CSVPrinter printer) Runs the metric on the given result and prints a line to the CSV file.private void
EvaluatorRelationTypePrediction.writeConfusionMatrixMultiClass
(ExecutionResult r, File outFile) Modifier and TypeMethodDescriptionprivate String[]
EvaluatorCSV.determineAggregatedAlignmentExtensionValuesToWriteForCSV
(Set<ExecutionResult> results) static long
EvaluatorCSV.getSummedRuntimeOfResults
(Set<ExecutionResult> results) -
Uses of ExecutionResult in de.uni_mannheim.informatik.dws.melt.matching_eval.evaluator.metric
Modifier and TypeMethodDescriptionprotected abstract MetricResult
Metric.compute
(ExecutionResult executionResult) Metric.get
(ExecutionResult executionResult) Triggers the computation of the metric for an individual execution result.Modifier and TypeMethodDescriptionvoid
MetricResultPrinter.write
(Map<ExecutionResult, MetricResult> results, Writer writer) -
Uses of ExecutionResult in de.uni_mannheim.informatik.dws.melt.matching_eval.evaluator.metric.alignmentanalyzer
Modifier and TypeFieldDescriptionprivate ExecutionResult
AlignmentAnalyzerResult.executionResult
Execution result that was analyzed.Modifier and TypeMethodDescriptionAlignmentAnalyzerMetric.compute
(ExecutionResult executionResult) ModifierConstructorDescription(package private)
AlignmentAnalyzerResult
(ExecutionResult executionResult, double minimumConfidence, double maximumConfidence, Map<CorrespondenceRelation, Integer> frequenciesOfRelations, boolean isHomogenousAlingment, Map<String, Integer> frequenciesOfMappingTypes, int urisCorrectPosition, int urisIncorrectPosition, List<String> urisNotFound, Map<Arity, Integer> arityCounts, String parsingErrorMessage) Constructor -
Uses of ExecutionResult in de.uni_mannheim.informatik.dws.melt.matching_eval.evaluator.metric.cm
Modifier and TypeMethodDescriptionConfusionMatrixMetric.getMacroAveragesForResults
(Iterable<ExecutionResult> resultsForCalculation) Returns aggregated confusion matrices according to the macro average.ConfusionMatrixMetric.getMacroAveragesForResults
(Iterable<ExecutionResult> resultsForCalculation, int numberOfTestCases) Returns aggregated confusion matrices according to the macro average.ConfusionMatrixMetric.getMicroAveragesForResults
(Iterable<ExecutionResult> resultsForCalculation) Returns aggregated confusion matrices according to the micro average. -
Uses of ExecutionResult in de.uni_mannheim.informatik.dws.melt.matching_eval.evaluator.metric.cmrelation
Modifier and TypeMethodDescriptionvoid
CMRelation.bla
(ExecutionResult r) CMRelationMetric.compute
(ExecutionResult executionResult) -
Uses of ExecutionResult in de.uni_mannheim.informatik.dws.melt.matching_eval.evaluator.metric.ranking
Modifier and TypeMethodDescriptionprotected RankingResult
RankingMetric.compute
(ExecutionResult executionResult) protected RankingResult
RankingMetricGroup.compute
(ExecutionResult executionResult) protected Alignment
RankingMetric.getSystemResultReducedToGoldStandardEntities
(ExecutionResult executionResult) Return the system alignment but only with correspondences where the source or the target appear also in the gold standard. -
Uses of ExecutionResult in de.uni_mannheim.informatik.dws.melt.matching_eval.evaluator.metric.resultsSimilarity
Modifier and TypeMethodDescriptionMatcherSimilarity.getCoordinates()
Get coordinates for visualizing the matcher distances in a 2D space.MatcherSimilarity.getExecutionResultsAsList()
Obtain all Execution results that are used in theMatcherSimilarity.matcherSimilaritySet
as ArrayList.Modifier and TypeMethodDescription(package private) void
MatcherSimilarity.add
(ExecutionResult executionResult_1, ExecutionResult executionResult_2, double similarity) static double
MatcherSimilarityMetric.computeSimilarity
(ExecutionResult executionResult_1, ExecutionResult executionResult_2) Computes the Jaccard overlap between two system results.double
MatcherSimilarity.getMatcherSimilarity
(ExecutionResult executionResult_1, ExecutionResult executionResult_2) Returns the matcher similarity between the two execution results.ModifierConstructorDescriptionExecutionResultTuple
(ExecutionResult result1, ExecutionResult result2) -
Uses of ExecutionResult in de.uni_mannheim.informatik.dws.melt.matching_eval.evaluator.significance
Modifier and TypeMethodDescriptionprivate double
EvaluatorMcNemarSignificance.pValueConsideringFalsePositives
(ExecutionResult executionResult1, ExecutionResult executionResult2) Given two execution results, it is determined whether the two results are significantly different (p < alpha).private double
EvaluatorMcNemarSignificance.pValueConsideringFalsePositives
(ExecutionResult executionResult1, ExecutionResult executionResult2, TestType testType) GGiven two execution results, it is determined whether the two results are significantly different (p < alpha). -
Uses of ExecutionResult in de.uni_mannheim.informatik.dws.melt.matching_eval.evaluator.util
Modifier and TypeMethodDescriptionstatic void
EvaluatorUtil.copySystemAlignment
(ExecutionResult executionResult, File alignmentFileToBeWritten) Writes the system alignment to the specified file. -
Uses of ExecutionResult in de.uni_mannheim.informatik.dws.melt.matching_eval.evaluator.visualization.resultspage
Modifier and TypeMethodDescriptionResultsPageUtil.getMatcherRefinement
(String matcher, TestCase testcase, String refinement) Modifier and TypeMethodDescriptionResultsPageUtil.getMatcherRefinement
(String matcher, String refinement) Modifier and TypeMethodDescriptionResultsPageUtil.getConfusionMatrix
(ExecutionResult result) ResultsPageUtil.getRuntime
(ExecutionResult result) int
ResultsPageUtil.getSystemSize
(ExecutionResult result) Modifier and TypeMethodDescriptionResultsPageUtil.getAverageConfusionMatrix
(Set<ExecutionResult> results) ResultsPageUtil.getAverageConfusionMatrixOverAll
(Set<ExecutionResult> results) ResultsPageUtil.getAvgSystemSize
(Set<ExecutionResult> results) ResultsPageUtil.getSummedRuntime
(Set<ExecutionResult> results) -
Uses of ExecutionResult in de.uni_mannheim.informatik.dws.melt.matching_eval.paramtuning
Modifier and TypeMethodDescriptionstatic double
ConfidenceFinder.getBestConfidenceForFmeasure
(ExecutionResult executionResult) Given an ExecutionResult, this method determines the best cutting point in order to optimize the F1-score.static double
ConfidenceFinder.getBestConfidenceForFmeasureBeta
(ExecutionResult executionResult, double beta) Given an ExecutionResult, this method determines the best cutting point in order to optimize the F_beta-score (beta is given as a parameter).static double
ConfidenceFinder.getBestConfidenceForPrecision
(ExecutionResult executionResult) Given an ExecutionResult, this method determines the best cutting point in order to optimize the precision.static ExecutionResultSet
ConfidenceFinder.getConfidenceResultSet
(ExecutionResult executionResult) -
Uses of ExecutionResult in de.uni_mannheim.informatik.dws.melt.matching_eval.refinement
Modifier and TypeFieldDescriptionprivate ExecutionResult
ResidualRefiner.baselineExecutionResult
The baseline execution results.Modifier and TypeMethodDescriptionAlignmentClosureRefiner.refine
(ExecutionResult toBeRefined) ConfidenceRefiner.refine
(ExecutionResult toBeRefined) Refiner.refine
(ExecutionResult toBeRefined) Create a new refined ExecutionResult from an ExecutionResult.RelationTypeRefiner.refine
(ExecutionResult toBeRefined) ResidualRefiner.refine
(ExecutionResult toBeRefined) TypeRefiner.refine
(ExecutionResult toBeRefined) Modifier and TypeMethodDescriptionAlignmentClosureRefiner.refine
(ExecutionResult toBeRefined) ConfidenceRefiner.refine
(ExecutionResult toBeRefined) Refiner.refine
(ExecutionResult toBeRefined) Create a new refined ExecutionResult from an ExecutionResult.RelationTypeRefiner.refine
(ExecutionResult toBeRefined) ResidualRefiner.refine
(ExecutionResult toBeRefined) TypeRefiner.refine
(ExecutionResult toBeRefined) ModifierConstructorDescriptionResidualRefiner
(ExecutionResult baselineExecutionResult) Constructor. -
Uses of ExecutionResult in de.uni_mannheim.informatik.dws.melt.matching_eval.visualization
Modifier and TypeMethodDescriptionstatic void
LatexPrecisionRecall.write
(Map<ExecutionResult, ConfusionMatrix> results, File f) static void
LatexPrecisionRecall.write
(Map<ExecutionResult, ConfusionMatrix> results, PrintWriter writer) static void
LatexPrecisionRecall.write
(Map<ExecutionResult, ConfusionMatrix> results, PrintWriter writer, List<Double> precisonLineValues, List<Double> recallLineValues, List<Double> fMeasureLineValues)