runner#

class FlagEmbedding.evaluation.mkqa.MKQAEvalRunner(eval_args: AbsEvalArgs, model_args: AbsEvalModelArgs)[source]#

Evaluation runner of MKQA.

load_data_loader() → MKQAEvalDataLoader[source]#

Load the data loader instance by args.

Returns:: The MKQA data loader instance.
Return type:: MKQAEvalDataLoader

load_evaluator() → MKQAEvaluator[source]#

Load the evaluator instance by args.

Returns:: The MKQA evaluator instance.
Return type:: MKQAEvaluator