Ishaan Jaff
c8fe600dbf
fix case when gemini is used
2024-09-10 17:06:45 -07:00
Ishaan Jaff
7891b3742c
fix vertex use async func to set auth creds
2024-09-10 16:12:18 -07:00
Krish Dholakia
6f354ecac6
fix(pass_through_endpoints): support bedrock agents via pass through ( #5527 )
2024-09-04 22:22:22 -07:00
Ishaan Jaff
ea30be2d91
fix pass through construct_target_url when vertex_proj is None
2024-09-02 12:51:30 -07:00
Krish Dholakia
ca4e746545
LiteLLM minor fixes + improvements (31/08/2024) ( #5464 )
...
* fix(vertex_endpoints.py): fix vertex ai pass through endpoints
* test(test_streaming.py): skip model due to end of life
* feat(custom_logger.py): add special callback for model hitting tpm/rpm limits
Closes https://github.com/BerriAI/litellm/issues/4096
2024-09-01 13:31:42 -07:00
Krish Dholakia
e474c3665a
Bedrock Embeddings refactor + model support ( #5462 )
...
* refactor(bedrock): initial commit to refactor bedrock to a folder
Improve code readability + maintainability
* refactor: more refactor work
* fix: fix imports
* feat(bedrock/embeddings.py): support translating embedding into amazon embedding formats
* fix: fix linting errors
* test: skip test on end of life model
* fix(cohere/embed.py): fix linting error
* fix(cohere/embed.py): fix typing
* fix(cohere/embed.py): fix post-call logging for cohere embedding call
* test(test_embeddings.py): fix error message assertion in test
2024-09-01 13:29:58 -07:00
Ishaan Jaff
1b9aa7b357
vertex forward all headers from vertex
2024-08-30 11:05:23 -07:00
Ishaan Jaff
6491e461d6
vertex add vertex endpoints
2024-08-29 15:49:25 -07:00
Ishaan Jaff
bfb5136489
refactor vertex endpoints to pass through all routes
2024-08-21 17:08:42 -07:00
Krrish Dholakia
a9025280bd
feat(langfuse_endpoints.py): support team based logging for langfuse pass-through endpoints
2024-08-19 17:58:39 -07:00
Krrish Dholakia
4b15f5bc83
feat(langfuse_endpoints.py): support langfuse pass through endpoints by default
2024-08-19 17:28:34 -07:00
Krrish Dholakia
c5d1899940
feat(Support-pass-through-for-bedrock-endpoints): Allows pass-through support for bedrock endpoints
2024-08-17 17:57:43 -07:00
Krrish Dholakia
1856ac585d
feat(pass_through_endpoints.py): add pass-through support for all cohere endpoints
2024-08-17 16:57:55 -07:00
Krrish Dholakia
b2ffa564d1
feat(pass_through_endpoints.py): support streaming requests
2024-08-17 12:46:57 -07:00
Krrish Dholakia
29bedae79f
feat(google_ai_studio_endpoints.py): support pass-through endpoint for all google ai studio requests
...
New Feature
2024-08-17 10:46:59 -07:00
Krrish Dholakia
3b9eb7ca1e
docs(vertex_ai.md): cleanup docs
2024-08-17 08:38:01 -07:00
Ishaan Jaff
b9e1d60357
add native cachedContents endpoint
2024-08-08 15:32:07 -07:00
Ishaan Jaff
5afb55576e
docs default vertex
2024-08-03 18:09:48 -07:00
Ishaan Jaff
e6e539fc4a
add vertex ai countTokens endpoint
2024-08-03 17:34:10 -07:00
Ishaan Jaff
01cd07fa75
add vertex embeddings endpoints
2024-08-03 17:26:49 -07:00
Ishaan Jaff
beb7f1b2c6
add vertex generateContent
2024-08-03 17:17:54 -07:00
Ishaan Jaff
a293bebdb1
working code for vertex ai routes
2024-08-03 16:56:33 -07:00
Ishaan Jaff
568fd8aa63
use native endpoints
2024-08-03 16:52:43 -07:00
