Anthropic support

[samuelcolvin]

So far we have OpenAI and Gemini, adding Anthropic seems a pretty obvious next step.

I don't think there are any other models we need to add to the core library immediately?

[igor-silveira]

I'll try to add it! Thats ok?

[igor-silveira]

@samuelcolvin i dont have permission to push a new branch. Can you give me permission to create new branches?

[samuelcolvin]

@igor-silveira you have permission to create a fork and create a pull request from there - that's how GitHub works.

[sydney-runkle]

I'd be happy to pick this up, hoping to have a PR up by EOD :)

[MarcusElwin]

Think Mistral AI or Bedrock would be nice if you want to handle EU needs

[samuelcolvin]

We have a separate issue about bedrock: #118.

Mistral models are already supported by groq, and will be supported by #112.

If you need something more, please create a new issue.

[dazzaji]

I'd be happy to pick this up, hoping to have a PR up by EOD :)

Is there a link to a PR for this you could share, perchance? No pressure to finish it if you're onto other things, but I'm super curious to give it a whirl!

[sydney-runkle]

@dazzaji,

Ah yeah, got tied up with some other things late last week. I'll prioritize this tomorrow. I can send a link then.

That being said, if you're really eager, feel free to start up, I'm happy to collaborate!

[sagarspatil]

Can’t wait for you guys to finish this :)
Function calling only works great with Anthropic right now.

[sydney-runkle]

@dazzaji,

I'm getting rolling on this now :).

[PRAYALANKAR]

what about support for the Openai from azure ?

[mdelder]

Is this support ready? When trying to adopt the Anthropic shim, it looks like the anthropic model files aren’t included in the latest 0.0.12 release. I couldn’t tell if there was a bug in the docs, a bug in the packaging or a user error in my part?

[pietermoller-glydepay]

I'm getting the same issue that @mdelder raised.

[ramonvg]

Same issue here as @mdelder. It seems documentation and code are not aligned?

[samuelcolvin]

We haven't made a release yet, will do tomorrow.

You can always install from main if you're impatient.

[mdelder]

I ended up building from main and it worked for me.

Thanks!

[samuelcolvin]

it made a release last night.

[pietermoller-glydepay]

The release now has the Anthropic models. Thanks so much!