dummy/a_plus_b_includes/mistralai--mistral-7b-instruct-v0.1

mistral-7b-instruct-v0.1 sometimes computes a + b incorrectly.

Attributes

func: The lambda function to be executed. Should return a bool. ```

Prompt

Chat

[bubble:user|Compute [{a}(empty=true)|] + [{b}(empty=true)|]. Write a single number.]

LVE Details

Checker:LambdaChecker
Checker Configuration:

func: lambda r, a, b: str(int(a) + int(b)) in r

Last updated 27.11.2023 16:53:57
Contributed by mbalunovic.

Loading...