Together AI vendor support.

[enricoros]

Add support for Together models; for instance, the new Nous Mixtral is released there first.

[enricoros]

Implemented full support, included description (context window) of the latest models, and rate limiting for the free tier.

1.11.0.-.Together.AI.support.-.2024-01-15.150641.mp4

[enricoros]

Very fast performance!

1.11.0.-.Together.AI.support2.-.2024-01-15.162652.mp4

[qdrop17]

Awesome project indeed; unfortunately this feature seems to be broken atm; or there's an incompatibility with the API:

Unexpected token 'A', "An error o"... is not valid JSON

[enricoros]

@qdrop17 I just tried it now and it works perfectly here.

Did you self-deploy or used the hosted version?

Anything special related to your API key? (lmk if you are able to provide a temp key for me to try, to check under the same conditions)

[qdrop17]

I self-deployed it. But the issue resolved itself when I retried. Maybe a temporary issue with the TogetherAI API.

[enricoros]

I self-deployed it. But the issue resolved itself when I retried. Maybe a temporary issue with the TogetherAI API.

Thanks, very possible.