From 64548654ee7b74ad3f8f1309061a403fd500cd54 Mon Sep 17 00:00:00 2001 From: SumanthRH Date: Wed, 13 Nov 2024 15:41:45 -0800 Subject: [PATCH] x Signed-off-by: SumanthRH --- templates/e2e-dspy-workflow/README.md | 4 ++++ 1 file changed, 4 insertions(+) diff --git a/templates/e2e-dspy-workflow/README.md b/templates/e2e-dspy-workflow/README.md index 2f4207ebb..50e7ac16d 100644 --- a/templates/e2e-dspy-workflow/README.md +++ b/templates/e2e-dspy-workflow/README.md @@ -378,6 +378,8 @@ sanity_check_program(llama_70b, vanilla_program, ft_trainset[0]) ``` Program input: Example({'text': 'I still have not received an answer as to why I was charged $1.00 in a transaction?'}) (input_keys={'text'}) + + Program output label: extra_charge_on_statement @@ -792,6 +794,8 @@ except ValueError as e: ``` Program input: Example({'text': 'I still have not received an answer as to why I was charged $1.00 in a transaction?'}) (input_keys={'text'}) + + Non fine-tuned model returned invalid output out and errored out with Expected dict_keys(['reasoning', 'label']) but got dict_keys([]) Program input: Example({'text': 'I still have not received an answer as to why I was charged $1.00 in a transaction?'}) (input_keys={'text'}) Fine-tuned model returned invalid output out and errored out with Expected dict_keys(['reasoning', 'label']) but got dict_keys([])