Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Raise error "Exception in ASGI application..uvicorn.protocols.utils.ClientDisconnected" when asking questions in Chinese. #66

Open
shinyke opened this issue Mar 19, 2024 · 0 comments

Comments

@shinyke
Copy link

shinyke commented Mar 19, 2024

OS: Win10
Lepton search version: lep, version 0.18.0
Deploy method: local machine & deploy in dashboard.lepton.ai

Hi, I try to deploy a search_with_lepton in my local machine.
Here is my param:

export GOOGLE_SEARCH_API_KEY=AIza....
export GOOGLE_SEARCH_CX=0011......
export BACKEND=GOOGLE

After the deployment is successful, there is no problem when asking questions in English. But once the question is in Chinese, there is an anomaly, such as this:
Image
response UI:
Image

error log:

2024-03-19 11:28:12,525 - ERROR:    Exception in ASGI application
  + Exception Group Traceback (most recent call last):
  |   File "...\.conda\envs\ml\Lib\site-packages\uvicorn\protocols\http\h11_impl.py", line 408, in run_asgi
  |     result = await app(  # type: ignore[func-returns-value]
  |              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  |   File "...\.conda\envs\ml\Lib\site-packages\uvicorn\middleware\proxy_headers.py", line 69, in __call__
  |     return await self.app(scope, receive, send)
  |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  |   File "...\.conda\envs\ml\Lib\site-packages\fastapi\applications.py", line 1054, in __call__
  |     await super().__call__(scope, receive, send)
  |   File "...\.conda\envs\ml\Lib\site-packages\starlette\applications.py", line 123, in __call__
  |     await self.middleware_stack(scope, receive, send)
  |   File "...\.conda\envs\ml\Lib\site-packages\starlette\middleware\errors.py", line 186, in __call__
  |     raise exc
  |   File "...\.conda\envs\ml\Lib\site-packages\starlette\middleware\errors.py", line 164, in __call__
  |     await self.app(scope, receive, _send)
  |   File "...\.conda\envs\ml\Lib\site-packages\prometheus_fastapi_instrumentator\middleware.py", line 174, in __call__
  |     raise exc
  |   File "...\.conda\envs\ml\Lib\site-packages\prometheus_fastapi_instrumentator\middleware.py", line 172, in __call__
  |     await self.app(scope, receive, send_wrapper)
  |   File "...\.conda\envs\ml\Lib\site-packages\starlette\middleware\cors.py", line 91, in __call__
  |     await self.simple_response(scope, receive, send, request_headers=headers)
  |   File "...\.conda\envs\ml\Lib\site-packages\starlette\middleware\cors.py", line 146, in simple_response
  |     await self.app(scope, receive, send)
  |   File "...\.conda\envs\ml\Lib\site-packages\starlette\middleware\exceptions.py", line 62, in __call__
  |     await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
  |   File "...\.conda\envs\ml\Lib\site-packages\starlette\_exception_handler.py", line 64, in wrapped_app
  |     raise exc
  |   File "...\.conda\envs\ml\Lib\site-packages\starlette\_exception_handler.py", line 53, in wrapped_app
  |     await app(scope, receive, sender)
  |   File "...\.conda\envs\ml\Lib\site-packages\starlette\routing.py", line 758, in __call__
  |     await self.middleware_stack(scope, receive, send)
  |   File "...\.conda\envs\ml\Lib\site-packages\starlette\routing.py", line 778, in app
  |     await route.handle(scope, receive, send)
  |   File "...\.conda\envs\ml\Lib\site-packages\starlette\routing.py", line 299, in handle
  |     await self.app(scope, receive, send)
  |   File "...\.conda\envs\ml\Lib\site-packages\starlette\routing.py", line 79, in app
  |     await wrap_app_handling_exceptions(app, request)(scope, receive, send)
  |   File "...\.conda\envs\ml\Lib\site-packages\starlette\_exception_handler.py", line 64, in wrapped_app
  |     raise exc
  |   File "...\.conda\envs\ml\Lib\site-packages\starlette\_exception_handler.py", line 53, in wrapped_app
  |     await app(scope, receive, sender)
  |   File "...\.conda\envs\ml\Lib\site-packages\starlette\routing.py", line 77, in app
  |     await response(scope, receive, send)
  |   File "...\.conda\envs\ml\Lib\site-packages\starlette\responses.py", line 257, in __call__
  |     async with anyio.create_task_group() as task_group:
  |   File "...\.conda\envs\ml\Lib\site-packages\anyio\_backends\_asyncio.py", line 678, in __aexit__
  |     raise BaseExceptionGroup(
  | ExceptionGroup: unhandled errors in a TaskGroup (1 sub-exception)
  +-+---------------- 1 ----------------
    | Traceback (most recent call last):
    |   File "...\.conda\envs\ml\Lib\site-packages\starlette\responses.py", line 260, in wrap
    |     await func()
    |   File "...\.conda\envs\ml\Lib\site-packages\starlette\responses.py", line 252, in stream_response
    |     await send({"type": "http.response.body", "body": chunk, "more_body": True})
    |   File "...\.conda\envs\ml\Lib\site-packages\starlette\_exception_handler.py", line 50, in sender
    |     await send(message)
    |   File "...\.conda\envs\ml\Lib\site-packages\starlette\_exception_handler.py", line 50, in sender
    |     await send(message)
    |   File "...\.conda\envs\ml\Lib\site-packages\starlette\middleware\cors.py", line 152, in send
    |     await send(message)
    |   File "...\.conda\envs\ml\Lib\site-packages\prometheus_fastapi_instrumentator\middleware.py", line 169, in send_wrapper
    |     await send(message)
    |   File "...\.conda\envs\ml\Lib\site-packages\starlette\middleware\errors.py", line 161, in _send
    |     await send(message)
    |   File "...\.conda\envs\ml\Lib\site-packages\uvicorn\protocols\http\h11_impl.py", line 461, in send
    |     raise ClientDisconnected
    | uvicorn.protocols.utils.ClientDisconnected
    +------------------------------------

I briefly traced the code and the exception occurred here. After getting The first word The, pronounce the second word incorrectly.
Image

image

I also try deploy Lepton Search in dashboard.lepton.ai, meet the same problem.

However, there is no such problem in the official demo, all Chinese questions can be answered normally. Can you help me find out what's wrong with my deployment?
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant