Commit graph

1446 commits

Author SHA1 Message Date
Krrish Dholakia
3fee0b1dc5 fix(ollama_chat.py): fix passing auth headers to ollama
Fixes https://github.com/BerriAI/litellm/issues/5046
2024-08-05 09:33:09 -07:00
Krrish Dholakia
aab09f5b86 feat(vertex_httpx.py): Support gemini 'response_schema' param
Fixes https://github.com/BerriAI/litellm/pull/3366#issuecomment-2269183338
2024-08-05 07:56:44 -07:00
Krish Dholakia
bca71019ad
Merge branch 'main' into litellm_anthropic_api_streaming 2024-08-03 21:16:50 -07:00
Krrish Dholakia
ac6c39c283 feat(anthropic_adapter.py): support streaming requests for /v1/messages endpoint
Fixes https://github.com/BerriAI/litellm/issues/5011
2024-08-03 20:16:19 -07:00
Ishaan Jaff
e73eb19678 docs default vertex 2024-08-03 18:09:48 -07:00
Ishaan Jaff
bef5a8b61f
Merge branch 'main' into litellm_support_native_vertex_endpoint 2024-08-03 17:47:35 -07:00
Ishaan Jaff
c8438715af add vertex ai countTokens endpoint 2024-08-03 17:34:10 -07:00
Ishaan Jaff
2d5c57e545 add vertex embeddings endpoints 2024-08-03 17:26:49 -07:00
Ishaan Jaff
c98733863a add vertex generateContent 2024-08-03 17:17:54 -07:00
Ishaan Jaff
8051781af0 working code for vertex ai routes 2024-08-03 16:56:33 -07:00
Ishaan Jaff
64c008045f use native endpoints 2024-08-03 16:52:43 -07:00
Krrish Dholakia
641192e049 fix(vertex_httpx.py): fix linting error 2024-08-03 12:53:46 -07:00
Ishaan Jaff
2e596c6c5b add support for pass through vertex ai ft jobs 2024-08-03 11:47:43 -07:00
Krrish Dholakia
c982ec88d8 fix(bedrock.py): fix response format for bedrock image generation response
Fixes https://github.com/BerriAI/litellm/issues/5010
2024-08-03 09:46:49 -07:00
Ishaan Jaff
9958c52f77 fix vertex ai 2024-08-03 08:56:54 -07:00
Ishaan Jaff
4ca0464395 fix linting errors 2024-08-03 08:55:36 -07:00
Ishaan Jaff
69e5a7cb68 test translating to vertex ai params 2024-08-03 08:44:54 -07:00
Ishaan Jaff
f840a5f6b4
Merge pull request #5028 from BerriAI/litellm_create_ft_job_gemini
[Feat] Add support for Vertex AI fine tuning endpoints
2024-08-03 08:22:55 -07:00
Krish Dholakia
fa82b2a412
Merge pull request #4982 from Manouchehri/bedrock-sts-custom-1
Allow Bedrock to set custom STS endpoint for OIDC flow
2024-08-02 23:42:38 -07:00
Ishaan Jaff
0463e73ee3 fix typing 2024-08-02 18:49:16 -07:00
Ishaan Jaff
f194aa3a93 fix typing 2024-08-02 18:46:43 -07:00
Ishaan Jaff
40430dde10 add support for sync vertex ft 2024-08-02 18:16:14 -07:00
Ishaan Jaff
db3b2a3ee0 fix translating response 2024-08-02 18:13:59 -07:00
Ishaan Jaff
0e70aca776 convert response obj from vertex ai 2024-08-02 18:13:25 -07:00
Ishaan Jaff
ac6224c2b1 translate response from vertex to openai 2024-08-02 18:02:24 -07:00
Ishaan Jaff
653cf55850 add fine tuning for vertex 2024-08-02 17:23:58 -07:00
Krish Dholakia
3d4ee61358
Merge pull request #5019 from BerriAI/litellm_deepseek_caching
fix(types/utils.py): Support deepseek prompt caching
2024-08-02 16:26:49 -07:00
Krrish Dholakia
0ce6c038ee fix(anthropic.py): fix linting error 2024-08-02 10:37:53 -07:00
Krrish Dholakia
fe2aa706e8 refactor(openai/azure.py): move to returning openai/azure response headers by default
Allows token tracking to work more reliably across multiple azure/openai deployments
2024-08-02 09:42:08 -07:00
Krrish Dholakia
4c2ef8ea64 fix(bedrock_httpx.py): fix ai21 streaming 2024-08-01 22:03:24 -07:00
Ishaan Jaff
7e79adc614 delete object from gcs 2024-08-01 18:07:14 -07:00
Ishaan Jaff
87e3d4d41a add better debugging statements for vertex logging 2024-08-01 18:07:14 -07:00
Krrish Dholakia
010d5ed81d feat(vertex_ai_partner.py): add vertex ai codestral FIM support
Closes https://github.com/BerriAI/litellm/issues/4984
2024-08-01 17:10:27 -07:00
Krrish Dholakia
246b3227a9 fix(vertex_ai_partner.py): add /chat/completion codestral support
Closes https://github.com/BerriAI/litellm/issues/4984
2024-08-01 16:12:05 -07:00
Krrish Dholakia
2a7ed84a23 fix(databricks.py): fix error handling 2024-08-01 15:15:45 -07:00
Krrish Dholakia
1affd4e2ca fix: add type hints for APIError and AnthropicError status codes
Fixes https://github.com/BerriAI/litellm/issues/5000
2024-08-01 15:08:54 -07:00
Krrish Dholakia
b6b86b2df4 fix(anthropic.py): respect timeouts
Fixes https://github.com/BerriAI/litellm/pull/4994
2024-08-01 09:16:19 -07:00
Ishaan Jaff
34838a29f9
Merge pull request #4989 from ec2ainun/fix/proxy-vertex-path
fix: support vertex filepath on proxy litellm_params definition
2024-08-01 09:15:24 -07:00
Moch. Ainun Najib
4e9e6a972b fix: support vertex path 2024-08-01 07:36:53 +07:00
Ishaan Jaff
d833c69acb
Merge pull request #4987 from BerriAI/litellm_add_ft_endpoints
[Feat-Proxy] Add List fine-tuning jobs
2024-07-31 16:49:59 -07:00
Krrish Dholakia
6202f9bbb0 fix(http_handler.py): correctly re-raise timeout exception 2024-07-31 14:51:28 -07:00
Ishaan Jaff
ff9bb96217 feat support azure ft create endpoint 2024-07-31 13:57:58 -07:00
Ishaan Jaff
ef5aeb17a1 fix pydantic obj for FT endpoints 2024-07-31 12:41:39 -07:00
David Manouchehri
ffbe1845ef
(bedrock_httpx.py) - Add support for custom STS endpoints, e.g. for FIPS. 2024-07-31 16:51:52 +00:00
Krrish Dholakia
c583cbdbcd fix: fix linting errors 2024-07-31 07:19:45 -07:00
Ishaan Jaff
82e5ea059b fix predibase timeout exceptions 2024-07-30 22:52:08 -07:00
Ishaan Jaff
da494da12c support timeouts on http handler 2024-07-30 22:49:00 -07:00
Ishaan Jaff
62d4d5e746 fix timeouts for predibase - they are unstable af 2024-07-30 22:48:30 -07:00
Ishaan Jaff
9b923e66e9 test azure fine tune job create 2024-07-30 16:46:06 -07:00
Ishaan Jaff
02736ac8b5 feat FT cancel and LIST endpoints for Azure 2024-07-30 16:03:31 -07:00