đī¸ What is the Relationship Between Evaluation Grades, Scores, and Pass/Fail Status?
The evaluation result for each sample can be presented in one of the following three forms:
đī¸ How to Set Custom Criterion Judgement Metrics
When users create their own evaluators based on custom criterion judgement, they can generate personalized evaluation metrics that meet their specific needs by simply adding their own evaluation criteria.
đī¸ How to create an evaluator with custom YAML configuration?
When creating an evaluator with a custom YAML configuration type, users will have more freedom to define the prompts used in the evaluation process and the form of evaluation. Here is a relatively complete YAML configuration example:
đī¸ What pre-built evaluators are currently supported?
We currently provide more than ten pre-built evaluators and nine templates for creating custom evaluators. Please refer to the list of pre-built evaluators in the Evaluators section, as well as the options provided when creating custom evaluators.