Commit graph

3884 commits

Author SHA1 Message Date
Krrish Dholakia
0e222cf76b feat(lakera_ai.py): support lakera custom thresholds + custom api base
Allows user to configure thresholds to trigger prompt injection rejections
2024-08-06 15:21:45 -07:00
Krrish Dholakia
34213edb91 fix(utils.py): fix dynamic api base 2024-08-06 11:27:39 -07:00
Krrish Dholakia
511f4d33d1 feat(utils.py): check env var for api base for openai-compatible endpoints
Closes https://github.com/BerriAI/litellm/issues/5066
2024-08-06 08:32:44 -07:00
Ishaan Jaff
63e853e161 ci/cd run again 2024-08-05 22:33:49 -07:00
Krrish Dholakia
4603eedcc1 fix: fix test 2024-08-05 22:20:33 -07:00
Krrish Dholakia
ea902f40de test(test_router_init.py): cleanup tests 2024-08-05 21:48:43 -07:00
Krrish Dholakia
ce39649b2a fix: fix test to specify allowed_fails 2024-08-05 21:39:59 -07:00
Ishaan Jaff
797a171962 ci/cd run again 2024-08-05 21:21:01 -07:00
Ishaan Jaff
0bf4554b80 fix test cache_key 2024-08-05 21:09:36 -07:00
Ishaan Jaff
5425861a54 fix cache_key check 2024-08-05 21:04:25 -07:00
Krrish Dholakia
e9df81ac19 test(test_key_generate_prisma.py): cleanup test 2024-08-05 20:29:53 -07:00
Ishaan Jaff
107c468d05 run ci/cd again 2024-08-05 20:04:19 -07:00
Krrish Dholakia
5c6dcd6029 test: improve debugging for test 2024-08-05 19:41:08 -07:00
Ishaan Jaff
4538eb848f run ci/cd again 2024-08-05 16:52:45 -07:00
Ishaan Jaff
28a37c0069 fix test fine tuning api azure 2024-08-05 15:17:15 -07:00
Ishaan Jaff
533ffd6020 test proxy server routes 2024-08-05 15:17:15 -07:00
Krrish Dholakia
aef25d5d00 fix: cleanup test 2024-08-05 11:23:49 -07:00
Krrish Dholakia
a9fdfb5a99 fix(init.py): rename feature_flag 2024-08-05 11:23:20 -07:00
Krrish Dholakia
3c4c78a71f feat(caching.py): enable caching on provider-specific optional params
Closes https://github.com/BerriAI/litellm/issues/5049
2024-08-05 11:18:59 -07:00
Krrish Dholakia
cd94c3adc1 fix(types/router.py): remove model_info pydantic field
Fixes https://github.com/BerriAI/litellm/issues/5042
2024-08-05 09:58:44 -07:00
Ishaan Jaff
0214ff5fe0
Merge pull request #5047 from BerriAI/litellm_log_request_response_gcs
[Feat-Proxy] Log request/response on GCS
2024-08-05 09:05:56 -07:00
Krrish Dholakia
f610fba58f fix(user_api_key_auth.py): handle older user_role's
Fixes issue where older user_role's (e.g. app_user) weren't being recognized. + Adds testing for it
2024-08-05 08:57:06 -07:00
Ishaan Jaff
a6e4fdf502 test gcs bucket 2024-08-05 08:56:10 -07:00
Krrish Dholakia
aab09f5b86 feat(vertex_httpx.py): Support gemini 'response_schema' param
Fixes https://github.com/BerriAI/litellm/pull/3366#issuecomment-2269183338
2024-08-05 07:56:44 -07:00
Krish Dholakia
bca71019ad
Merge branch 'main' into litellm_anthropic_api_streaming 2024-08-03 21:16:50 -07:00
Krish Dholakia
c5fe467cdd
Merge pull request #5025 from jcheng5/streaming-tools-anthropic
Handle bedrock tool calling in stream_chunk_builder
2024-08-03 20:31:05 -07:00
Krrish Dholakia
23cad65256 test: fix test 2024-08-03 20:28:11 -07:00
Krrish Dholakia
ac6c39c283 feat(anthropic_adapter.py): support streaming requests for /v1/messages endpoint
Fixes https://github.com/BerriAI/litellm/issues/5011
2024-08-03 20:16:19 -07:00
Ishaan Jaff
93b0d23997 fix fine tune api tests 2024-08-03 19:02:11 -07:00
Ishaan Jaff
7fae2aa394 ci/cd run again 2024-08-03 18:48:10 -07:00
Ishaan Jaff
009697425d fix fine tuning tests 2024-08-03 18:34:26 -07:00
Ishaan Jaff
1c1631222c fix test test_aimage_generation_vertex_ai 2024-08-03 18:32:52 -07:00
Krrish Dholakia
ed8b20fa18 fix(utils.py): parse out aws specific params from openai call
Fixes https://github.com/BerriAI/litellm/issues/5009
2024-08-03 12:04:44 -07:00
Krrish Dholakia
c982ec88d8 fix(bedrock.py): fix response format for bedrock image generation response
Fixes https://github.com/BerriAI/litellm/issues/5010
2024-08-03 09:46:49 -07:00
Ishaan Jaff
1d56c2f83e fix ft api test 2024-08-03 09:38:02 -07:00
Ishaan Jaff
a44ff761ab
Merge pull request #5034 from BerriAI/litellm_vtx_ft_param_mapping
[Feat] Vertex AI fine tuning - support translating hyperparameters
2024-08-03 09:33:44 -07:00
Krrish Dholakia
4258295a07 feat(utils.py): Add github as a provider
Closes https://github.com/BerriAI/litellm/issues/4922#issuecomment-2266564469
2024-08-03 09:11:22 -07:00
Ishaan Jaff
4ca0464395 fix linting errors 2024-08-03 08:55:36 -07:00
Ishaan Jaff
69e5a7cb68 test translating to vertex ai params 2024-08-03 08:44:54 -07:00
Ishaan Jaff
f840a5f6b4
Merge pull request #5028 from BerriAI/litellm_create_ft_job_gemini
[Feat] Add support for Vertex AI fine tuning endpoints
2024-08-03 08:22:55 -07:00
Krish Dholakia
fa82b2a412
Merge pull request #4982 from Manouchehri/bedrock-sts-custom-1
Allow Bedrock to set custom STS endpoint for OIDC flow
2024-08-02 23:42:38 -07:00
Ishaan Jaff
057bb37a39 test vertex ft jobs 2024-08-02 22:03:52 -07:00
Joe Cheng
1fbfc09b44 Add unit test 2024-08-02 20:51:08 -07:00
Ishaan Jaff
960de8a3d0 test ft response vertex ai 2024-08-02 18:02:34 -07:00
Ishaan Jaff
7ec1f241fc
Merge pull request #5026 from BerriAI/litellm_fix_whisper_caching
[Fix] Whisper Caching - Use correct cache keys for checking request in cache
2024-08-02 17:26:28 -07:00
Ishaan Jaff
d7ab440280 example vertex ai.jsonl 2024-08-02 17:25:32 -07:00
Ishaan Jaff
cb8a592ccf test vertex ft 2024-08-02 17:25:18 -07:00
Krish Dholakia
3d4ee61358
Merge pull request #5019 from BerriAI/litellm_deepseek_caching
fix(types/utils.py): Support deepseek prompt caching
2024-08-02 16:26:49 -07:00
Ishaan Jaff
87a15b408f fix test 2024-08-02 15:08:44 -07:00
Ishaan Jaff
d6c3560ff1 test whisper 2024-08-02 15:07:38 -07:00