Commit graph

3426 commits

Author SHA1 Message Date
ishaan-jaff
4eb9221121 (fix) track EmbeddingResponse cost 2024-01-18 12:29:21 -08:00
ishaan-jaff
88cdfedf84 (feat) track cost streaming 2024-01-18 12:21:56 -08:00
ishaan-jaff
b0e18e92b6 (fix) when kwargs==None 2024-01-18 12:05:08 -08:00
ishaan-jaff
d14d36af9a (v0 ) working - writing /chat/completion spend tracking 2024-01-18 11:54:15 -08:00
Krrish Dholakia
c8dd36db9e fix(proxy_server.py): show all models user has access to in /models 2024-01-18 10:56:37 -08:00
ishaan-jaff
4a5f987512 (feat) insert_data to spend table 2024-01-18 10:09:02 -08:00
ishaan-jaff
4821fa9201 (v0) add schema.prisma 2024-01-18 10:04:34 -08:00
Krish Dholakia
658fd4de38
Merge pull request #1495 from puffo/litellm_ollama_chat_fix
fix(ollama_chat.py): use tiktoken as backup for prompt token counting
2024-01-18 10:02:27 -08:00
Ishaan Jaff
143e225194
Merge pull request #1496 from BerriAI/litellm_unit_test_key_endpoints
[Test+Fix] /Key/Info, /Key/Update - Litellm unit test key endpoints
2024-01-18 09:55:30 -08:00
ishaan-jaff
08ee65f894 (test) /key/update, /key/info 2024-01-18 09:35:02 -08:00
ishaan-jaff
fc1eb36f24 (fix) /key/update overwriting metadata 2024-01-18 09:32:56 -08:00
Krrish Dholakia
96122a4f88 fix(proxy/utils.py): fix isoformat to string logic 2024-01-18 09:32:30 -08:00
Ishaan Jaff
7db04afaca
Merge pull request #1494 from duarteocarmo/patch-1
Update s3 cache to support folder
2024-01-18 09:16:19 -08:00
puffo
becff369dc fix(ollama_chat.py): use tiktoken as backup for prompt token counting 2024-01-18 10:47:24 -06:00
Duarte OC
dbadd64395 revert comment 2024-01-18 17:26:38 +01:00
Krrish Dholakia
71034099c9 fix(proxy/utils.py): prisma client fix get data to handle list return 2024-01-18 07:49:13 -08:00
Duarte OC
578256a6a2
Update s3 cache to support folder 2024-01-18 11:38:05 +01:00
ishaan-jaff
85b5395692 (test) use os.environ/ for azure vision enhance 2024-01-17 21:26:47 -08:00
ishaan-jaff
79c412cab5 (feat) set Azure vision enhancement params using os.environ 2024-01-17 21:23:40 -08:00
ishaan-jaff
0414e40d4a (docs) also test gpt-4 vision enhancements 2024-01-17 18:46:41 -08:00
ishaan-jaff
debef7544d (feat) return Azure enahncements used 2024-01-17 18:46:41 -08:00
Krish Dholakia
e9ac001005
Merge pull request #1483 from BerriAI/litellm_model_access_groups_feature
feat(proxy_server.py): support model access groups
2024-01-17 18:16:53 -08:00
Ishaan Jaff
15ae9182db
Merge pull request #1484 from BerriAI/litellm_access_key_metadata_in_callbacks
[Feat] Proxy - Access Key metadata in callbacks
2024-01-17 18:08:08 -08:00
ishaan-jaff
f3a45ea044 (fix) cleanup 2024-01-17 17:54:18 -08:00
ishaan-jaff
8df3a86178 (feat) proxy - set endpoint called in callback 2024-01-17 17:44:28 -08:00
Krrish Dholakia
73daee7e07 fix(proxy_cli.py): ensure proxy always retries if db push fails to connect to db 2024-01-17 17:37:59 -08:00
ishaan-jaff
5c1ae3d412 (feat) langfuse send metadata as tags 2024-01-17 17:29:46 -08:00
Krrish Dholakia
cff9f7fee6 fix(proxy_server.py): handle empty insert_data response 2024-01-17 17:28:23 -08:00
Krrish Dholakia
08b409bae8 fix(utils.py): fix if check 2024-01-17 17:17:58 -08:00
ishaan-jaff
46f84bec69 (test) api_key metadata available in callback 2024-01-17 16:48:02 -08:00
ishaan-jaff
00dfb5918c (feat) proxy - log key metadata in calback 2024-01-17 16:42:49 -08:00
Krrish Dholakia
7ed4d9b4d1 fix(utils.py): allow dynamically setting boto3 init and switching between bedrock and openai 2024-01-17 15:56:30 -08:00
Krrish Dholakia
98b83fa780 feat(proxy_server.py): support model access groups 2024-01-17 15:45:31 -08:00
ishaan-jaff
66bcd431f6 (docs) add doc string for /key/delete 2024-01-17 15:27:48 -08:00
ishaan-jaff
9b3d24bbe0 (test) key/delete 2024-01-17 14:55:54 -08:00
ishaan-jaff
0250492d95 (fix) /key/delete 2024-01-17 14:54:29 -08:00
Ishaan Jaff
cbb4484bce
Merge pull request #1478 from BerriAI/litellm_unit_test_proxy_key_gen
[Test] Proxy -  Unit Test proxy key gen
2024-01-17 13:38:38 -08:00
ishaan-jaff
a0eec51ee6 (test) expired key prisma 2024-01-17 13:24:15 -08:00
ishaan-jaff
5f7a89d2e7 (test) prisma - non expiring keys 2024-01-17 13:05:23 -08:00
ishaan-jaff
399f0ba620 (fix) prisma - non expiring keys 2024-01-17 12:56:26 -08:00
ishaan-jaff
f1ae6957ca (test) use fixture for prisma 2024-01-17 12:44:06 -08:00
ishaan-jaff
62963146fe (test) prisma /key/gen 2024-01-17 12:23:45 -08:00
ishaan-jaff
2273f8055c (test) add test fixture for dynamodb testing 2024-01-17 12:23:04 -08:00
Krrish Dholakia
8e9dc09955 fix(bedrock.py): add support for sts based boto3 initialization
https://github.com/BerriAI/litellm/issues/1476
2024-01-17 12:08:59 -08:00
ishaan-jaff
4036c64bdf (test) prisma key gen 2024-01-17 11:58:14 -08:00
ishaan-jaff
ec68c3a29f (feat) improve Prisma Auth Error 2024-01-17 11:57:48 -08:00
ishaan-jaff
acbbccdef7 v0 testing 2024-01-17 11:28:59 -08:00
Ishaan Jaff
a8ee3511ef
Merge pull request #1475 from BerriAI/litellm_azure_vision_enhancements
[Feat] Support Azure GPT-4 Vision Enhancements
2024-01-17 11:18:56 -08:00
ishaan-jaff
67db73ab1a (test) init proxy router with gpt-vision enhancements 2024-01-17 10:54:37 -08:00
ishaan-jaff
0c4b86c211 (feat) litellm router - Azure, use base_url when set 2024-01-17 10:24:30 -08:00