Commit graph

1434 commits

Author SHA1 Message Date
Ishaan Jaff
64c008045f use native endpoints 2024-08-03 16:52:43 -07:00
Ishaan Jaff
2e596c6c5b add support for pass through vertex ai ft jobs 2024-08-03 11:47:43 -07:00
Ishaan Jaff
9958c52f77 fix vertex ai 2024-08-03 08:56:54 -07:00
Ishaan Jaff
4ca0464395 fix linting errors 2024-08-03 08:55:36 -07:00
Ishaan Jaff
69e5a7cb68 test translating to vertex ai params 2024-08-03 08:44:54 -07:00
Ishaan Jaff
f840a5f6b4
Merge pull request #5028 from BerriAI/litellm_create_ft_job_gemini
[Feat] Add support for Vertex AI fine tuning endpoints
2024-08-03 08:22:55 -07:00
Krish Dholakia
fa82b2a412
Merge pull request #4982 from Manouchehri/bedrock-sts-custom-1
Allow Bedrock to set custom STS endpoint for OIDC flow
2024-08-02 23:42:38 -07:00
Ishaan Jaff
0463e73ee3 fix typing 2024-08-02 18:49:16 -07:00
Ishaan Jaff
f194aa3a93 fix typing 2024-08-02 18:46:43 -07:00
Ishaan Jaff
40430dde10 add support for sync vertex ft 2024-08-02 18:16:14 -07:00
Ishaan Jaff
db3b2a3ee0 fix translating response 2024-08-02 18:13:59 -07:00
Ishaan Jaff
0e70aca776 convert response obj from vertex ai 2024-08-02 18:13:25 -07:00
Ishaan Jaff
ac6224c2b1 translate response from vertex to openai 2024-08-02 18:02:24 -07:00
Ishaan Jaff
653cf55850 add fine tuning for vertex 2024-08-02 17:23:58 -07:00
Krish Dholakia
3d4ee61358
Merge pull request #5019 from BerriAI/litellm_deepseek_caching
fix(types/utils.py): Support deepseek prompt caching
2024-08-02 16:26:49 -07:00
Krrish Dholakia
0ce6c038ee fix(anthropic.py): fix linting error 2024-08-02 10:37:53 -07:00
Krrish Dholakia
fe2aa706e8 refactor(openai/azure.py): move to returning openai/azure response headers by default
Allows token tracking to work more reliably across multiple azure/openai deployments
2024-08-02 09:42:08 -07:00
Krrish Dholakia
4c2ef8ea64 fix(bedrock_httpx.py): fix ai21 streaming 2024-08-01 22:03:24 -07:00
Ishaan Jaff
7e79adc614 delete object from gcs 2024-08-01 18:07:14 -07:00
Ishaan Jaff
87e3d4d41a add better debugging statements for vertex logging 2024-08-01 18:07:14 -07:00
Krrish Dholakia
010d5ed81d feat(vertex_ai_partner.py): add vertex ai codestral FIM support
Closes https://github.com/BerriAI/litellm/issues/4984
2024-08-01 17:10:27 -07:00
Krrish Dholakia
246b3227a9 fix(vertex_ai_partner.py): add /chat/completion codestral support
Closes https://github.com/BerriAI/litellm/issues/4984
2024-08-01 16:12:05 -07:00
Krrish Dholakia
2a7ed84a23 fix(databricks.py): fix error handling 2024-08-01 15:15:45 -07:00
Krrish Dholakia
1affd4e2ca fix: add type hints for APIError and AnthropicError status codes
Fixes https://github.com/BerriAI/litellm/issues/5000
2024-08-01 15:08:54 -07:00
Krrish Dholakia
b6b86b2df4 fix(anthropic.py): respect timeouts
Fixes https://github.com/BerriAI/litellm/pull/4994
2024-08-01 09:16:19 -07:00
Ishaan Jaff
34838a29f9
Merge pull request #4989 from ec2ainun/fix/proxy-vertex-path
fix: support vertex filepath on proxy litellm_params definition
2024-08-01 09:15:24 -07:00
Moch. Ainun Najib
4e9e6a972b fix: support vertex path 2024-08-01 07:36:53 +07:00
Ishaan Jaff
d833c69acb
Merge pull request #4987 from BerriAI/litellm_add_ft_endpoints
[Feat-Proxy] Add List fine-tuning jobs
2024-07-31 16:49:59 -07:00
Krrish Dholakia
6202f9bbb0 fix(http_handler.py): correctly re-raise timeout exception 2024-07-31 14:51:28 -07:00
Ishaan Jaff
ff9bb96217 feat support azure ft create endpoint 2024-07-31 13:57:58 -07:00
Ishaan Jaff
ef5aeb17a1 fix pydantic obj for FT endpoints 2024-07-31 12:41:39 -07:00
David Manouchehri
ffbe1845ef
(bedrock_httpx.py) - Add support for custom STS endpoints, e.g. for FIPS. 2024-07-31 16:51:52 +00:00
Krrish Dholakia
c583cbdbcd fix: fix linting errors 2024-07-31 07:19:45 -07:00
Ishaan Jaff
82e5ea059b fix predibase timeout exceptions 2024-07-30 22:52:08 -07:00
Ishaan Jaff
da494da12c support timeouts on http handler 2024-07-30 22:49:00 -07:00
Ishaan Jaff
62d4d5e746 fix timeouts for predibase - they are unstable af 2024-07-30 22:48:30 -07:00
Ishaan Jaff
9b923e66e9 test azure fine tune job create 2024-07-30 16:46:06 -07:00
Ishaan Jaff
02736ac8b5 feat FT cancel and LIST endpoints for Azure 2024-07-30 16:03:31 -07:00
Ishaan Jaff
566dc43d96 add azure files api 2024-07-30 15:45:43 -07:00
Ishaan Jaff
63cbb6e634 add azure fine tuning apis 2024-07-30 15:45:15 -07:00
Krish Dholakia
653aefde40
Merge branch 'main' into litellm_async_cohere_calls 2024-07-30 15:35:20 -07:00
Krish Dholakia
3a70849ce0
Merge pull request #4976 from BerriAI/litellm_huggingface_embedding_fixes
feat(huggingface_restapi.py): Support multiple hf embedding types + async hf embeddings
2024-07-30 15:34:44 -07:00
Krrish Dholakia
311521e56e fix(ollama.py): correctly raise ollama streaming error
Fixes https://github.com/BerriAI/litellm/issues/4974
2024-07-30 15:01:26 -07:00
Krrish Dholakia
9b2eb1702b fix(cohere.py): support async cohere embedding calls 2024-07-30 14:49:07 -07:00
Krrish Dholakia
43958907bf fix(huggingface_restapi.py): fix linting errors 2024-07-30 14:33:08 -07:00
Krrish Dholakia
250f28b3a2 style(cohere.py): point to cohere_chat docs for updated doc info 2024-07-30 13:47:15 -07:00
Ishaan Jaff
23769b3603 rename fine tuning apis 2024-07-30 13:44:16 -07:00
Krrish Dholakia
69afbc6091 feat(huggingface_restapi.py): Support multiple hf embedding types + async hf embeddings
Closes https://github.com/BerriAI/litellm/issues/3261
2024-07-30 13:32:03 -07:00
Ishaan Jaff
66211b42db fix linting errors 2024-07-30 12:51:39 -07:00
Ishaan Jaff
43a06f408c feat add support for alist_batches 2024-07-30 08:18:52 -07:00