Ishaan Jaff
96fa9d46f5
fix case when gemini is used
2024-09-10 17:06:45 -07:00
Ishaan Jaff
1c6f8b1be2
fix vertex use async func to set auth creds
2024-09-10 16:12:18 -07:00
Krish Dholakia
ca37bb9de5
fix(pass_through_endpoints): support bedrock agents via pass through ( #5527 )
2024-09-04 22:22:22 -07:00
Ishaan Jaff
c8fc453b75
fix pass through construct_target_url when vertex_proj is None
2024-09-02 12:51:30 -07:00
Krish Dholakia
e0d81434ed
LiteLLM minor fixes + improvements (31/08/2024) ( #5464 )
...
* fix(vertex_endpoints.py): fix vertex ai pass through endpoints
* test(test_streaming.py): skip model due to end of life
* feat(custom_logger.py): add special callback for model hitting tpm/rpm limits
Closes https://github.com/BerriAI/litellm/issues/4096
2024-09-01 13:31:42 -07:00
Krish Dholakia
37f9705d6e
Bedrock Embeddings refactor + model support ( #5462 )
...
* refactor(bedrock): initial commit to refactor bedrock to a folder
Improve code readability + maintainability
* refactor: more refactor work
* fix: fix imports
* feat(bedrock/embeddings.py): support translating embedding into amazon embedding formats
* fix: fix linting errors
* test: skip test on end of life model
* fix(cohere/embed.py): fix linting error
* fix(cohere/embed.py): fix typing
* fix(cohere/embed.py): fix post-call logging for cohere embedding call
* test(test_embeddings.py): fix error message assertion in test
2024-09-01 13:29:58 -07:00
Ishaan Jaff
50014aa78e
vertex forward all headers from vertex
2024-08-30 11:05:23 -07:00
Ishaan Jaff
9fb188a3b6
vertex add vertex endpoints
2024-08-29 15:49:25 -07:00
Ishaan Jaff
0e1d3804ff
refactor vertex endpoints to pass through all routes
2024-08-21 17:08:42 -07:00
Krrish Dholakia
f9640d8a58
feat(langfuse_endpoints.py): support team based logging for langfuse pass-through endpoints
2024-08-19 17:58:39 -07:00
Krrish Dholakia
1701c48ad5
feat(langfuse_endpoints.py): support langfuse pass through endpoints by default
2024-08-19 17:28:34 -07:00
Krrish Dholakia
663a0c1b83
feat(Support-pass-through-for-bedrock-endpoints): Allows pass-through support for bedrock endpoints
2024-08-17 17:57:43 -07:00
Krrish Dholakia
f7a2e04426
feat(pass_through_endpoints.py): add pass-through support for all cohere endpoints
2024-08-17 16:57:55 -07:00
Krrish Dholakia
fd44cf8d26
feat(pass_through_endpoints.py): support streaming requests
2024-08-17 12:46:57 -07:00
Krrish Dholakia
bc0023a409
feat(google_ai_studio_endpoints.py): support pass-through endpoint for all google ai studio requests
...
New Feature
2024-08-17 10:46:59 -07:00
Krrish Dholakia
08411f37b4
docs(vertex_ai.md): cleanup docs
2024-08-17 08:38:01 -07:00
Ishaan Jaff
0d662368ac
add native cachedContents endpoint
2024-08-08 15:32:07 -07:00
Ishaan Jaff
e73eb19678
docs default vertex
2024-08-03 18:09:48 -07:00
Ishaan Jaff
c8438715af
add vertex ai countTokens endpoint
2024-08-03 17:34:10 -07:00
Ishaan Jaff
2d5c57e545
add vertex embeddings endpoints
2024-08-03 17:26:49 -07:00
Ishaan Jaff
c98733863a
add vertex generateContent
2024-08-03 17:17:54 -07:00
Ishaan Jaff
8051781af0
working code for vertex ai routes
2024-08-03 16:56:33 -07:00
Ishaan Jaff
64c008045f
use native endpoints
2024-08-03 16:52:43 -07:00
