Commit graph

8953 commits

Author SHA1 Message Date
Ishaan Jaff
196884a779 fix trace hierarchy on otel 2024-07-06 15:37:23 -07:00
Ishaan Jaff
547f6ffdd5 ui new build 2024-07-06 15:26:26 -07:00
Ishaan Jaff
c2631ce860
Merge pull request #4422 from BerriAI/litellm_otel_env_name
[Feat] OTEL allow setting deployment environment
2024-07-06 15:23:07 -07:00
Ishaan Jaff
c91b254e25 fix OTEL TracerProvider 2024-07-06 15:15:49 -07:00
Ishaan Jaff
e815563638
Merge pull request #4578 from BerriAI/litellm_allow_querying_spend_report_by_key
[Feat-Enterprise] /spend/report view spend for a specific key
2024-07-06 15:11:46 -07:00
Ishaan Jaff
d61cc598b0
Merge pull request #4576 from BerriAI/litellm_encrypt_decrypt_using_salt
[Refactor] Use helper function to encrypt/decrypt model credentials
2024-07-06 15:11:09 -07:00
Krish Dholakia
127f08ee67
Merge branch 'main' into litellm_tts_pricing 2024-07-06 14:57:34 -07:00
Krish Dholakia
b3ef1ac18c
Merge branch 'main' into litellm_proxy_tts_pricing 2024-07-06 14:56:16 -07:00
Krrish Dholakia
27e9f96380 fix(main.py): fix stream_chunk_builder usage calc
Closes https://github.com/BerriAI/litellm/issues/4496
2024-07-06 14:52:59 -07:00
Ishaan Jaff
f691ff7005 get spend per internal user / api_key 2024-07-06 14:45:58 -07:00
Ishaan Jaff
3623d49c2f /spend/report view spend for a specific key 2024-07-06 14:24:29 -07:00
Ishaan Jaff
3fa64023ea test - test_init_clients_async_mode 2024-07-06 14:08:35 -07:00
Ishaan Jaff
c268ead43f fix links on admin ui 2024-07-06 14:00:49 -07:00
Ishaan Jaff
7f6f85ec3c improve sign up flow - show missing env vars 2024-07-06 13:57:19 -07:00
Ishaan Jaff
bf9e85c8d1 use a salt key for encrypt/decryption 2024-07-06 13:27:44 -07:00
Ishaan Jaff
a5d9a6cebd init litellm router 2024-07-06 13:14:04 -07:00
Ishaan Jaff
984cc4722e fix should_initialize_sync_client 2024-07-06 13:10:22 -07:00
Ishaan Jaff
2609de43d0 use helper for init client + check if we should init sync clients 2024-07-06 12:52:41 -07:00
Ishaan Jaff
80a31c5dab allow async_only_mode on rotuer 2024-07-06 12:50:57 -07:00
Krrish Dholakia
85d723f5f8 fix(utils.py): fix openrouter exception handling 2024-07-06 12:36:05 -07:00
Krrish Dholakia
f62884da14 fix(cost_calculator.py): fix completion_response check 2024-07-06 12:28:46 -07:00
Ishaan Jaff
2e956f7c01 fix checking store_model_in_deb 2024-07-06 11:35:28 -07:00
Ishaan Jaff
e477b7e3da fix linting error 2024-07-06 11:27:58 -07:00
Ishaan Jaff
6b2856e064 fix decrypt value logic 2024-07-06 11:26:12 -07:00
Krrish Dholakia
1b14202582 fix(litellm_logging.py): fix 'use_custom_pricing_for_model' helper function 2024-07-06 11:20:55 -07:00
Krish Dholakia
ea9718a848
Merge branch 'main' into litellm_proxy_tts_pricing 2024-07-06 11:16:07 -07:00
Krrish Dholakia
71edb28d6a fix(proxy_server.py): fix embedding model exception mapping 2024-07-06 11:14:41 -07:00
Ishaan Jaff
8f0b55879f move encrypt / decrypt to helper 2024-07-06 11:09:47 -07:00
Ishaan Jaff
4e7a99e0f9 fix - make encrypt / decrypt helpers 2024-07-06 11:08:30 -07:00
Krish Dholakia
f7ebb84488
Merge branch 'main' into litellm_tts_pricing 2024-07-06 11:02:59 -07:00
Krrish Dholakia
2452753e08 build(model_prices_and_context_window.json): fix gemini-1.5-pro on google ai studio pricing 2024-07-06 10:46:02 -07:00
Krrish Dholakia
3f83e8a8d4 fix(caching.py): fix async redis health check 2024-07-06 09:14:29 -07:00
Krrish Dholakia
c7338f9798 build(model_prices_and_context_window.json): add openai + azure tts pricing 2024-07-05 22:17:36 -07:00
Krrish Dholakia
6e43cdcb17 feat(litellm_logging.py): support cost tracking for tts calls 2024-07-05 22:09:08 -07:00
Krrish Dholakia
407639cc7d fix(cost_calculator.py): support openai+azure tts calls 2024-07-05 20:58:08 -07:00
Ishaan Jaff
285cb50821 fix init for async http handler 2024-07-05 20:29:47 -07:00
Ishaan Jaff
e444b465a2 fix import galileo issue 2024-07-05 20:26:02 -07:00
Ishaan Jaff
51e7099b13
Merge pull request #4569 from BerriAI/litelm_control_guardrails_api_key
feat - control guardrails per api key
2024-07-05 19:56:15 -07:00
Ishaan Jaff
ae29780258
Merge pull request #4566 from BerriAI/litellm_anthropic_Streaming
fix - raise report Anthropic streaming errors
2024-07-05 19:56:05 -07:00
Ishaan Jaff
8958a9bf8c
Merge pull request #4565 from BerriAI/litellm_fix_nvidia_nim_param_mapping
[Fix] Add nvidia nim param mapping based on `model`
2024-07-05 19:55:57 -07:00
Ishaan Jaff
982dfe64c0
Merge pull request #4567 from BerriAI/litellm_add_galileo_logging
[Feat] Add Galileo Logging Callback
2024-07-05 19:55:30 -07:00
Ishaan Jaff
22e31cb1ed feat - control guardrails per api key 2024-07-05 19:39:07 -07:00
Ishaan Jaff
e9319085f8 feat - init galileo logger 2024-07-05 19:17:09 -07:00
Krrish Dholakia
6090fd37fa fix(test_proxy_reject_logging.py): fix test 2024-07-05 19:09:37 -07:00
Ishaan Jaff
7bab381029 feat - galileo logging 2024-07-05 16:25:08 -07:00
Ishaan Jaff
dc1d69f2a0 add galileo response pydantic obj 2024-07-05 16:21:00 -07:00
Ishaan Jaff
47b9f04928 fix - raise report Anthropic streaming errors 2024-07-05 15:31:06 -07:00
Krrish Dholakia
fd11f63f71 fix(utils.py): log failure to sync failure callbacks as well 2024-07-05 14:49:34 -07:00
Ishaan Jaff
e5c49548ea fix nvidia nim param mapping 2024-07-05 14:44:12 -07:00
Krrish Dholakia
b1b21b0340 fix(proxy/utils.py): support logging rejected requests to langfuse, etc. 2024-07-05 14:39:35 -07:00