aac_metrics.classes.fense module

class FENSE(
return_all_scores: bool = True,
*,
sbert_model: str | SentenceTransformer = 'paraphrase-TinyBERT-L6-v2',
echecker: str | BERTFlatClassifier = 'echecker_clotho_audiocaps_base',
echecker_tokenizer: AutoTokenizer | None = None,
error_threshold: float = 0.9,
device: str | device | None = 'cuda_if_available',
batch_size: int | None = 32,
reset_state: bool = True,
return_probs: bool = False,
penalty: float = 0.9,
verbose: int = 0,
)[source]

Bases: AACMetric[tuple[FENSEScores, FENSEScores] | Tensor]

Fluency ENhanced Sentence-bert Evaluation (FENSE)

For more information, see fense().

compute() → tuple[FENSEScores, FENSEScores] | Tensor[source]
extra_repr() → str[source]

Return the extra representation of the module.

To print customized extra information, you should re-implement this method in your own modules. Both single-line and multi-line strings are acceptable.

full_state_update : ClassVar[bool | None] = False
get_output_names() → tuple[str, ...][source]
higher_is_better : ClassVar[bool | None] = True
is_differentiable : ClassVar[bool | None] = False
max_value : ClassVar[float] = 1.0
min_value : ClassVar[float] = -1.0
reset() → None[source]
training : bool
update(
candidates: list[str],
mult_references: list[list[str]],
) → None[source]