Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error when parsing JSON: Empty strings are not legal JSON5 #726

Open
Breamer opened this issue Jul 17, 2024 · 1 comment
Open

Error when parsing JSON: Empty strings are not legal JSON5 #726

Breamer opened this issue Jul 17, 2024 · 1 comment
Labels
bug Something isn't working

Comments

@Breamer
Copy link

Breamer commented Jul 17, 2024

I'm using a python AWS lambda function to run evaluations using Bedrock, with model Claude 3.5 sonnet and Uptrain version 0.7.1.

I'm getting an "Error when parsing JSON" error when trying to run evaluations, depending on the data processed.

Steps to reproduce the behavior:

Create a lambda function using python 3.11
Install uptrain
Use bedrock to run a factual accuracy evaluation

See error

ERROR | uptrain.operators.language.llm:parse_json:55 - Error when parsing JSON: Empty strings are not legal JSON5
ERROR | uptrain.operators.language.llm:async_process_payload:103 - Error when sending request to LLM API: Response doesn't pass the validation func.

@Breamer Breamer added the bug Something isn't working label Jul 17, 2024
@18811449050
Copy link

I also encountered the same problem

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants