Create an Eval Set

Body Params
string
required
uuid
required
string
Defaults to Your task is to decide if a submitted answer is correct. Follow these rules strictly: 1. If an expected output is provided: - The answer must include all exact values (numbers, strings, keywords) from the expected output. - Small differences in formatting, phrasing, or case are acceptable if the meaning is unchanged. - If values are missing, altered, or incorrect, the score is 0. - Otherwise, the score is 1. 2. If no expected output is provided: - Score 1 if the answer completely and correctly fulfills the input question/task. - Score 0 if it is incomplete, incorrect, or irrelevant. Return only a single score: 1 (correct) or 0 (incorrect).
Responses

Language
Credentials
URL
Response
Choose an example:
application/json