Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Quick question about the stream API for library author #7

Open
bZichett opened this issue Oct 3, 2024 · 1 comment
Open

Quick question about the stream API for library author #7

bZichett opened this issue Oct 3, 2024 · 1 comment

Comments

@bZichett
Copy link

bZichett commented Oct 3, 2024

Is there a particular reason that stream.go doesn't augment with the provided tools as the sync client does? Limitation with streaming and ollama? (final output required before sending etc, I am, in short, not sure and doubting my understanding)

By the way, this is a very neat and clean package. I just got it working with http2 and a streaming client on browser. Thank you, kindly.

@bZichett
Copy link
Author

bZichett commented Oct 3, 2024

ollama/ollama#5796 which links to ollama/ollama#7014 at the end.

I see the related ollama discussion now ^

Looking forward to this, not entirely clear how langchain does it, or even if that is accurate but above is a PR to improve support on ollama.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant