Commit graph

503 commits

Author SHA1 Message Date
Ishaan Jaff
b85c48ff17 add fireworks ai param mapping 2024-06-26 06:43:18 -07:00
Ishaan Jaff
ca372f7599 feat - add param mapping for nvidia nim 2024-06-25 09:13:08 -07:00
Ishaan Jaff
5021eec6a6 add nvidia nim to __init__ 2024-06-25 08:53:06 -07:00
Krrish Dholakia
8843b0dc77 feat(dynamic_rate_limiter.py): working e2e 2024-06-22 14:41:22 -07:00
Krrish Dholakia
8f95381276 refactor: instrument 'dynamic_rate_limiting' callback on proxy 2024-06-22 00:32:29 -07:00
Krrish Dholakia
60b4249767 fix(utils.py): re-integrate separate gemini optional param mapping (google ai studio)
Fixes https://github.com/BerriAI/litellm/issues/4333
2024-06-21 09:01:32 -07:00
Wonseok Lee (Jack)
86d87a3f38 Merge branch 'main' into feat/friendliai 2024-06-21 10:50:03 +09:00
Krish Dholakia
6f94456f40 Merge branch 'main' into litellm_gemini_refactoring 2024-06-17 19:50:56 -07:00
Ishaan Jaff
d89de2fd72 fix logfire 2024-06-17 19:21:35 -07:00
Krrish Dholakia
cc1ec55e5b fix(vertex_httpx.py): check if model supports system messages before sending separately 2024-06-17 17:32:38 -07:00
Krish Dholakia
18d9dcc4db Merge branch 'main' into litellm_gemini_refactoring 2024-06-17 17:28:50 -07:00
Ishaan Jaff
952b9fa482 Merge pull request #4247 from BerriAI/litellm_add_codestral_fim
[Feat] Add Codestral FIM API
2024-06-17 16:35:47 -07:00
Ishaan Jaff
87386b5cc3 feat - add fim codestral api 2024-06-17 13:46:03 -07:00
Krrish Dholakia
e31465d940 feat(main.py): initial commit - refactoring google ai studio to just use vertex httpx
Uses the same calling logic for google ai studio/vertex ai. Simplifies logic, gives google ai studio integration all of vertex
ai features.
2024-06-17 13:31:46 -07:00
Ishaan Jaff
2a5eabcceb feat add text completion config for mistral text 2024-06-17 12:48:46 -07:00
Ishaan Jaff
1a30068f90 vo - init commit adding codestral API 2024-06-17 11:05:24 -07:00
Krrish Dholakia
6482e57f56 fix(__init__.py): add gemini models to all model list
Fixes https://github.com/BerriAI/litellm/issues/4240
2024-06-17 10:54:28 -07:00
Krrish Dholakia
7de77ab677 fix(init.py): fix imports 2024-06-15 11:31:09 -07:00
Krrish Dholakia
9d7f5d503c refactor(utils.py): refactor Logging to it's own class. Cut down utils.py to <10k lines.
Easier debugging

 Reference: https://github.com/BerriAI/litellm/issues/4206
2024-06-15 10:57:20 -07:00
Krrish Dholakia
734bd5ef85 feat(router.py): support content policy fallbacks
Closes https://github.com/BerriAI/litellm/issues/2632
2024-06-14 17:15:44 -07:00
Krrish Dholakia
3f957ee6e1 feat(__init__.py): allow setting drop_params as an env
Closes https://github.com/BerriAI/litellm/issues/4175
2024-06-13 16:00:14 -07:00
Krish Dholakia
50c74fce49 Merge branch 'main' into litellm_vertex_completion_httpx 2024-06-12 21:19:22 -07:00
Krrish Dholakia
e60b0e96e4 fix(vertex_httpx.py): add function calling support to httpx route 2024-06-12 21:11:00 -07:00
Ishaan Jaff
994b88118b feat - add azure ai studio models on litellm ui 2024-06-12 20:28:16 -07:00
Krrish Dholakia
1dac2aa59f fix(vertex_httpx.py): support streaming via httpx client 2024-06-12 19:55:14 -07:00
Wonseok Lee (Jack)
99632752eb Merge branch 'main' into feat/friendliai 2024-06-13 09:59:56 +09:00
Ishaan Jaff
dbdf102a01 feat - add mistral embedding config 2024-06-12 15:00:00 -07:00
Ishaan Jaff
e4b36d71cf feat - support vertex ai dimensions 2024-06-12 09:29:51 -07:00
Krrish Dholakia
47cf36646e fix(__init__.py): fix linting error 2024-06-11 18:42:01 -07:00
Krish Dholakia
bb9653eedb Merge pull request #4134 from BerriAI/litellm_azure_ai_route
Azure AI support all models
2024-06-11 18:24:05 -07:00
Krrish Dholakia
a545615054 fix(__init__.py): add 'log_raw_request_response' flag to init 2024-06-11 17:26:03 -07:00
Krrish Dholakia
4a27a50f9b fix(utils.py): add new 'azure_ai/' route
supports azure's openai compatible api endpoint
2024-06-11 14:06:56 -07:00
Krrish Dholakia
e7967eb763 fix(utils.py): allow user to opt in to raw request logging to langfuse 2024-06-11 13:35:22 -07:00
wslee
61badd8fd6 change friendli_ai -> friendliai 2024-06-11 16:17:30 +09:00
wslee
2ba421fbe0 add friendli_ai provider 2024-06-10 17:27:15 +09:00
Krrish Dholakia
0a886eed6a fix(cost_calculator.py): fixes tgai unmapped model pricing
Fixes error where tgai helper function returned None. Enforces stronger type hints, refactors code, adds more unit testing.
2024-06-08 19:43:57 -07:00
Ishaan Jaff
c9c25a8ede Merge branch 'main' into litellm_redact_messages_slack_alerting 2024-06-07 12:43:53 -07:00
Krish Dholakia
7bf5c61007 Merge branch 'main' into litellm_bedrock_converse_api 2024-06-07 08:49:52 -07:00
Krrish Dholakia
c41b60f6bf feat(bedrock_httpx.py): working bedrock converse api streaming 2024-06-06 22:13:21 -07:00
Krrish Dholakia
6f3468aee4 fix(utils.py): fix exception mapping for azure internal server error 2024-06-06 17:12:30 -07:00
Ishaan Jaff
3df177d0d0 feat - redact messages from slack alerting 2024-06-06 10:38:15 -07:00
Krrish Dholakia
96b556f385 feat(bedrock_httpx.py): add support for bedrock converse api
closes https://github.com/BerriAI/litellm/issues/4000
2024-06-05 21:20:36 -07:00
Ishaan Jaff
ed14b02b07 feat - working audit logs for create, update delete team 2024-06-05 17:50:27 -07:00
Krrish Dholakia
7432c6a4d9 fix(utils.py): fix cost calculation for openai-compatible streaming object 2024-06-04 10:36:25 -07:00
Krish Dholakia
127d1457de Merge pull request #3996 from BerriAI/litellm_azure_assistants_api_support
feat(assistants/main.py): Azure Assistants API support
2024-06-03 21:05:03 -07:00
Krrish Dholakia
a2ba63955a feat(assistants/main.py): Closes https://github.com/BerriAI/litellm/issues/3993 2024-06-03 18:47:05 -07:00
Krrish Dholakia
a2cf59a308 fix(langfuse.py): log litellm response cost as part of langfuse metadata 2024-06-03 12:58:30 -07:00
Ishaan Jaff
dd25d83087 Merge pull request #3962 from BerriAI/litellm_return_num_rets_max_exceptions
[Feat] return `num_retries` and `max_retries` in exceptions
2024-06-01 17:48:38 -07:00
Ishaan Jaff
2341d99bdc feat - add num retries and max retries in exception 2024-06-01 16:53:00 -07:00
Krrish Dholakia
69244aabf3 fix(http_handler.py): allow setting ca bundle path 2024-06-01 14:48:53 -07:00