You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Added automated context-length detection to stdout so the user is always aware about the current context length.
Automated context trimming: If the current aggregated context is too long for the context length the auto_trim=True argument (can be called in client init or config) will ensure the most recent context which does not overflow the allowed length. Otherwise users are prone to run into errors like this.
Added cut_unfinished argument to client. If enabled all outputs will be truncated to the last fulfilled sentence, unfinished sentences will be cutoff.