Commit graph

14704 commits

Author SHA1 Message Date
Vinnie Giarrusso
a4b41e28a8 remove more unused imports 2024-07-16 12:25:06 -07:00
Vinnie Giarrusso
b83f47e941 refactor a bit 2024-07-16 12:19:31 -07:00
Vinnie Giarrusso
6ff863ee00 Add enabled_roles to Guardrails configuration, Update Lakera guardrail moderation hook 2024-07-16 01:52:08 -07:00
Ishaan Jaff
a99cb5deeb run ci/cd again 2024-07-15 22:09:17 -07:00
Krrish Dholakia
a4b0740c4a fix(test_custom_callback_input.py): fix unit test for embedding logging 2024-07-15 21:47:05 -07:00
Ishaan Jaff
2cfafdc7c3 fix test tg - they are a very unstable provider 2024-07-15 21:40:06 -07:00
Krish Dholakia
74e263b8de
Merge pull request #4723 from BerriAI/litellm_add_dynamic_api_base
fix(utils.py): allow passing dynamic api base for openai-compatible endpoints (Fireworks AI, etc.)
2024-07-15 21:35:22 -07:00
Krrish Dholakia
d136f2b8a7 fix(litellm_logging.py): fix circular reference 2024-07-15 21:28:33 -07:00
Ishaan Jaff
eaee90b02e docs - passing extra_headers to anthropic api 2024-07-15 21:15:39 -07:00
Krrish Dholakia
155ee7e99c fix(factory.py): allow converting pdf url to base64 2024-07-15 21:11:53 -07:00
Krish Dholakia
bbe98151ef
Merge pull request #4721 from danielbichuetti/fireworks-model-updates
[Feature]: Add Fireworks AI data to model_prices_and_context_window.json
2024-07-15 21:08:50 -07:00
Ishaan Jaff
0c015003d1 bump: version 1.41.22 → 1.41.23 2024-07-15 21:00:19 -07:00
Ishaan Jaff
4aa98dcbe9 test_amazing_sync_embedding 2024-07-15 20:53:13 -07:00
Ishaan Jaff
4baa48ba4b fix test_sync_embedding 2024-07-15 20:51:29 -07:00
Ishaan Jaff
254ac37f65
Merge pull request #4724 from BerriAI/litellm_Set_max_file_size_transc
[Feat] - set max file size on /audio/transcriptions
2024-07-15 20:42:24 -07:00
Ishaan Jaff
af19a2aff3 ui new build 2024-07-15 20:09:17 -07:00
Ishaan Jaff
979b5d8eea
Merge pull request #4719 from BerriAI/litellm_fix_audio_transcript
[Fix] /audio/transcription - don't write to the local file system
2024-07-15 20:05:42 -07:00
Ishaan Jaff
4dfc00ae0d
Merge pull request #4715 from BerriAI/litellm_stack_cache_ui_analytics
Admin UI - Stack Cache hits vs misses on UI
2024-07-15 20:05:32 -07:00
Ishaan Jaff
e1c1149a64 docs set max file size on requests 2024-07-15 20:05:14 -07:00
Ishaan Jaff
bac6685bfc fix linting 2024-07-15 20:02:41 -07:00
Krrish Dholakia
a15ba2592a fix(utils.py): allow passing dynamic api base for openai-compatible endpoints 2024-07-15 20:00:44 -07:00
Ishaan Jaff
0bd747ef7e max_file_size_mb in float 2024-07-15 19:58:41 -07:00
Ishaan Jaff
38cef1c58d fix error from max file size 2024-07-15 19:57:33 -07:00
Ishaan Jaff
685253568b doc set max file size 2024-07-15 19:57:17 -07:00
Krrish Dholakia
9e07af6c02 docs(vertex.md): Retrieve grounding metadata from call 2024-07-15 19:47:48 -07:00
Krrish Dholakia
023f10cf1c fix(vertex_httpx.py): return grounding metadata 2024-07-15 19:43:37 -07:00
Ishaan Jaff
48d28e37a4 fix set max_file_size 2024-07-15 19:41:38 -07:00
Ishaan Jaff
b5a2090720 use helper to check check_file_size_under_limit 2024-07-15 19:40:05 -07:00
Ishaan Jaff
6c060b1fdc check_file_size_under_limit 2024-07-15 19:38:08 -07:00
Ishaan Jaff
e65daef572 router return get_deployment_by_model_group_name 2024-07-15 19:27:12 -07:00
Krrish Dholakia
959c627dd3 fix(litellm_logging.py): log response_cost=0 for failed calls
Fixes https://github.com/BerriAI/litellm/issues/4604
2024-07-15 19:25:56 -07:00
Ishaan Jaff
865469e43f allow setting max_file_size_mb 2024-07-15 19:25:24 -07:00
Krrish Dholakia
9cc2daeec9 fix(utils.py): update get_model_info docstring
Fixes https://github.com/BerriAI/litellm/issues/4711
2024-07-15 18:18:50 -07:00
Daniel Bichuetti
cc906319ba
Update model_prices_and_context_window.json 2024-07-15 20:44:16 -03:00
Krrish Dholakia
ff1bcdd3b5 docs(streaming_logging.md): fix example 2024-07-15 14:58:15 -07:00
Ishaan Jaff
a900f352b5 fix - don't write file.filename 2024-07-15 14:56:01 -07:00
Krrish Dholakia
e8e31c4029 docs(enterprise.md): cleanup docs 2024-07-15 14:52:08 -07:00
Krish Dholakia
177424c27c
Merge pull request #4714 from djliden/main
updates cost tracking example code in docs to resolve errors
2024-07-15 14:50:09 -07:00
Ishaan Jaff
3dc2ec8119 fix show debugging utils on in mem usage 2024-07-15 10:05:57 -07:00
Ishaan Jaff
ced35cd841 stack cache hits 2024-07-15 09:10:39 -07:00
Daniel Liden
b789440854
Update streaming_logging.md
updates cost tracking code

- replace `completion_response` with `response_obj`
- add `import logging`
2024-07-15 10:21:55 -05:00
Krrish Dholakia
2bf1f06a0e bump: version 1.41.21 → 1.41.22 2024-07-14 08:06:53 -07:00
Krrish Dholakia
82ca7af6df fix(vertex_httpx.py): google search grounding fix 2024-07-14 08:06:17 -07:00
Krrish Dholakia
385da04d72 docs(vertex.md): add reference vertex ai grounding doc 2024-07-13 22:04:38 -07:00
Krrish Dholakia
fe6ea9f892 docs(user_keys.md): add openai js example to docs 2024-07-13 22:00:53 -07:00
Krish Dholakia
6bf60d773e
Merge pull request #4696 from BerriAI/litellm_guardrail_logging_only
Allow setting `logging_only` in guardrails config
2024-07-13 21:50:43 -07:00
Krish Dholakia
1e2e67c3fe
Merge pull request #4702 from BerriAI/litellm_add_azure_ai_pricing
add azure ai pricing + token info (mistral/jamba instruct/llama3)
2024-07-13 21:50:31 -07:00
Krish Dholakia
7bc9a189e7
Merge branch 'main' into litellm_add_azure_ai_pricing 2024-07-13 21:50:26 -07:00
Krrish Dholakia
9cca25f874 test(test_end_users.py): fix test 2024-07-13 21:46:19 -07:00
Krrish Dholakia
d475311eb3 test(test_presidio_pii_masking.py): fix presidio test 2024-07-13 21:44:22 -07:00