aac_metrics.functional.meteor module¶

class METEORScores¶

Bases: dict

meteor : Tensor¶

Metric for Evaluation of Translation with Explicit ORdering function.

Paper: https://dl.acm.org/doi/pdf/10.5555/1626355.1626389
Documentation: https://www.cs.cmu.edu/~alavie/METEOR/README.html
Original implementation: https://github.com/tylin/coco-caption

Parameters:¶

candidates: list[str]¶: The list of sentences to evaluate.
mult_references: list[list[str]]¶: The list of list of sentences used as target.
return_all_scores: bool = True¶: If True, returns a tuple containing the globals and locals scores. Otherwise returns a scalar tensor containing the main global score. defaults to True.
cache_path: str | Path | None = None¶: The path to the external code directory. defaults to the value returned by get_default_cache_path().
java_path: str | Path | None = None¶: The path to the java executable. defaults to the value returned by get_default_java_path().
java_max_memory: str = '2G'¶: The maximal java memory used. defaults to “2G”.
language: 'en' | 'cz' | 'de' | 'es' | 'fr' = 'en'¶: The language used for stem, synonym and paraphrase matching. Can be one of (“en”, “cz”, “de”, “es”, “fr”). defaults to “en”.
use_shell: bool | None = None¶: Optional argument to force use os-specific shell for the java subprogram. If None, it will use shell only on Windows OS. defaults to None.
params: Iterable[float] | None = None¶: List of 4 parameters (alpha, beta gamma delta) used in METEOR metric. If None, it will use the default of the java program, which is (0.85, 0.2, 0.6, 0.75). defaults to None.
weights: Iterable[float] | None = None¶: List of 4 parameters (w1, w2, w3, w4) used in METEOR metric. If None, it will use the default of the java program, which is (1.0 1.0 0.6 0.8). defaults to None.
verbose: int = 0¶: The verbose level. defaults to 0.

Returns:¶

A tuple of globals and locals scores or a scalar tensor with the main global score.