Skip to main content

How to Set Custom Criterion Judgement Metrics

When users create their own evaluators based on custom criterion judgement, they can generate personalized evaluation metrics that meet their specific needs by simply adding their own evaluation criteria.

When using an evaluator with "Custom Criterion Judgement" for evaluation, the large model will not refer to the ideal answers provided in the samples. Instead, it will evaluate the generated answers based on its own knowledge and capabilities, combined with the user-defined evaluation criteria. The evaluation forms will be scores and assertions, with scores being 0 or 1 and assertions being pass or fail.