aac_metrics.classes.fense module

class FENSE(

return_all_scores: bool = True,

*,

sbert_model: str | SentenceTransformer = 'paraphrase-TinyBERT-L6-v2',

echecker: str | BERTFlatClassifier = 'echecker_clotho_audiocaps_base',

echecker_tokenizer: AutoTokenizer | None = None,

error_threshold: float = 0.9,

device: str | device | None = 'cuda_if_available',

batch_size: int | None = 32,

reset_state: bool = True,

return_probs: bool = False,

penalty: float = 0.9,

verbose: int = 0,

)

Bases: AACMetric[tuple[FENSEScores, FENSEScores] | Tensor]

Fluency ENhanced Sentence-bert Evaluation (FENSE)

• Paper: https://arxiv.org/abs/2110.04684

• Original implementation: https://github.com/blmoistawinde/fense

For more information, see fense().

compute() → tuple[FENSEScores, FENSEScores] | Tensor

extra_repr() → str

Return the extra representation of the module.

To print customized extra information, you should re-implement this method in your own modules. Both single-line and multi-line strings are acceptable.

full_state_update: ClassVar[bool | None] = False

get_output_names() → tuple[str, ...]

higher_is_better: ClassVar[bool | None] = True

is_differentiable: ClassVar[bool | None] = False

max_value: ClassVar[float] = 1.0

min_value: ClassVar[float] = -1.0

reset() → None

training: bool

update(

candidates: list[str],

mult_references: list[list[str]],

) → None