Commit graph

4465 commits

Author SHA1 Message Date
ishaan-jaff
79fcd75de6 (ui) update build 2024-02-12 18:53:43 -08:00
Krish Dholakia
c4c1703c44
Merge pull request #1946 from BerriAI/litellm_proxy_routing_fix
Litellm proxy routing fix
2024-02-12 18:12:52 -08:00
Krrish Dholakia
460b48914e feat(sagemaker.py): initial commit of working sagemaker with aioboto3 2024-02-12 17:25:57 -08:00
ishaan-jaff
2bdc5a81ec (feat) ui - show user key when creating key 2024-02-12 16:55:34 -08:00
ishaan-jaff
211a1fcf53 (feat) /model/info add 3rd fallback 2024-02-12 16:40:41 -08:00
Krrish Dholakia
456ce692df test(test_proxy_exception_mapping.py): fix test 2024-02-12 16:25:35 -08:00
ishaan-jaff
cd1416e39c (feat) model/info have fallback check 2024-02-12 16:13:36 -08:00
ishaan-jaff
033c8d010c (fix) allow ui to show /model/info 2024-02-12 15:42:42 -08:00
Rena Lu
60c0bec7b3 refactor to separate private mode with custom mode 2024-02-12 18:20:48 -05:00
Alexandre Sorokine
36360c62ac Update utils.py: switched from pkg_resources to importlib.resources for filename stored in the os/environ(TIKTOKEN_CACHE_DIR) 2024-02-12 16:28:38 -05:00
Krrish Dholakia
1a452057af fix(proxy_server.py): fix exception raising 2024-02-12 11:13:02 -08:00
deena
b640ec4dc0 support langfuse tags feature 2024-02-12 19:49:11 +02:00
Krrish Dholakia
8f989235ea fix(proxy_server.py): restrict proxy to just listed models 2024-02-12 09:30:59 -08:00
Krrish Dholakia
5d59fa166c test: api error handling 2024-02-12 09:11:46 -08:00
stephenleo
37c83e0023 fix latency calc (lower better) 2024-02-11 17:06:46 +08:00
Krish Dholakia
1391490d92
Merge pull request #1931 from BerriAI/litellm_microsoft_presidio_pii
feat(proxy_server.py): support for pii masking with microsoft presidio
2024-02-11 00:27:14 -08:00
Ishaan Jaff
1cb8d2d3a3
Merge pull request #1933 from BerriAI/litellm_team_specific_models
[FEAT] Proxy - set team specific models
2024-02-10 21:40:13 -08:00
ishaan-jaff
7648aecf87 (fix) setting valid_models per team 2024-02-10 21:20:58 -08:00
ishaan-jaff
5ac5f6c53c (feat)team-specific models 2024-02-10 21:13:39 -08:00
Krish Dholakia
a36aa6aa01
Merge pull request #1926 from BerriAI/litellm_ui_further_improvements
Enable viewing key alias instead of hashed tokens
2024-02-10 20:52:23 -08:00
Krrish Dholakia
71f772d2f5 fix(proxy_server.py): support list as well as direct input for custom callbacks 2024-02-10 20:38:09 -08:00
Krrish Dholakia
72ec488461 fix(proxy_server.py): fix import 2024-02-10 20:31:54 -08:00
Krrish Dholakia
2d845b12ed feat(proxy_server.py): support for pii masking with microsoft presidio 2024-02-10 20:21:12 -08:00
ishaan-jaff
afd0d7cb41 (fix) undo today's mistake where bedrock was async 2024-02-10 18:32:29 -08:00
ishaan-jaff
18e73ec03d (feat) litellm set ssl_certificates 2024-02-10 17:52:47 -08:00
Krrish Dholakia
7e2e545bed fix(proxy_server.py): don't change old /key/info endpoint 2024-02-10 17:31:23 -08:00
Krrish Dholakia
f4dc643b1c test(test_key_generate_prisma.py): fix test import 2024-02-10 16:16:12 -08:00
Krrish Dholakia
34c118e5e9 feat(ui): show key alias instead of hashed token 2024-02-10 15:45:42 -08:00
Krrish Dholakia
6b83001459 feat(proxy_server.py): support key lists for /key/info 2024-02-10 14:24:12 -08:00
ishaan-jaff
757334c85f (fix) proxy - use bedrock in sync streaming 2024-02-10 09:47:33 -08:00
Krrish Dholakia
7409460230 fix(ui): export ui npm build 2024-02-10 08:43:41 -08:00
Krrish Dholakia
163d1d0e99 refactor(main.py): trigger new build 2024-02-09 21:01:12 -08:00
Krish Dholakia
a8ef8e12bb
Merge branch 'main' into litellm_ui_improvements_time_series 2024-02-09 20:54:36 -08:00
Krrish Dholakia
4678c6b936 fix(usage.tsx): show top users and top keys driving spend 2024-02-09 19:50:07 -08:00
Ishaan Jaff
304e337a59
Merge pull request #1922 from BerriAI/litellm_bedrock_proxy_timeout
[FEAT] Set timeout for bedrock on proxy
2024-02-09 19:22:25 -08:00
Ishaan Jaff
edec971da9
Merge pull request #1924 from BerriAI/litellm_fix_verbose_logger_utils
[FIX] Verbose Logger - don't double print CURL command
2024-02-09 19:02:01 -08:00
ishaan-jaff
e36f1af389 (feat) fix litellm verbose logger 2024-02-09 19:01:21 -08:00
Ishaan Jaff
93cb0a7738
Merge pull request #1921 from BerriAI/litellm_support_azure_deployments_embedding
[FEAT] Support azure deployments for /embeddings
2024-02-09 18:44:10 -08:00
Krrish Dholakia
6710c2ee5d fix(proxy_server.py): fix /spend/logs endpoint 2024-02-09 18:11:33 -08:00
ishaan-jaff
640011379c (feat) set timeout on proxy config 2024-02-09 17:42:35 -08:00
ishaan-jaff
3d97004b15 (feat) support timeout on bedrock 2024-02-09 17:42:17 -08:00
ishaan-jaff
09c36c6e78 (test) llama index VectorStoreIndex 2024-02-09 16:49:03 -08:00
ishaan-jaff
924b7db540 (feat) support azure deployments for embeddings 2024-02-09 16:47:01 -08:00
Krrish Dholakia
43da22ae13 feat(proxy_server.py): show admin global spend as time series data 2024-02-09 16:31:35 -08:00
Ishaan Jaff
0da1737b59
Merge pull request #1919 from BerriAI/litellm_bedrock_set_timeouts
[FEAT] Bedrock set timeouts on litellm.completion
2024-02-09 16:19:27 -08:00
ishaan-jaff
782e84a421 (test) Proxy llama index request 2024-02-09 16:09:03 -08:00
ishaan-jaff
2c116af596 (test) bedrock timeout 2024-02-09 14:38:17 -08:00
ishaan-jaff
6dc7ded1a6 (bedrock) raise timeout error 2024-02-09 14:37:34 -08:00
ishaan-jaff
896fd393db (feat) support bedrock timeout 2024-02-09 14:36:43 -08:00
Rena Lu
6833f37986 remove prints 2024-02-09 16:25:29 -05:00