Commit graph

1376 commits

Author SHA1 Message Date
ishaan-jaff
1c062b37e7 (test) add ollama tests to our ci/cd 2023-12-14 19:42:25 +05:30
ishaan-jaff
95454e5176 (feat) mistral - add exception mapping 2023-12-14 18:57:39 +05:30
ishaan-jaff
c1fff2af90 (test) mistral - safe_mode 2023-12-14 18:42:55 +05:30
ishaan-jaff
54cda01b3b (test) mistral api - safe_mode, random_seed 2023-12-14 18:42:43 +05:30
ishaan-jaff
4fb2dd7cae (test) mistral api streaming 2023-12-14 18:28:03 +05:30
ishaan-jaff
e47fab83ad (test) mistral ai api 2023-12-14 18:19:45 +05:30
ishaan-jaff
339da65fae (test) test_custom_callback - aembedding cache 2023-12-14 17:36:29 +05:30
Ishaan Jaff
c5b6b85449 Merge branch 'main' into fix-langfuse-tests 2023-12-14 16:55:47 +05:30
ishaan-jaff
ec0c284a4c (test) - caching - override when caching = False 2023-12-14 16:20:29 +05:30
ishaan-jaff
25efd43551 (feat) use async_cache for acompletion/aembedding 2023-12-14 16:04:45 +05:30
ishaan-jaff
5501e7af12 (test) caching - get cache key for embedding 2023-12-14 14:08:58 +05:30
ishaan-jaff
f65a3b86d0 (test) router - test_model_group_aliases 2023-12-14 13:16:44 +05:30
ishaan-jaff
de1b7ac86b (test) router - model_group_alias 2023-12-14 13:08:35 +05:30
ishaan-jaff
e367fb3bc1 (fix) custom_callback_input test 2023-12-14 12:40:07 +05:30
Krrish Dholakia
3bdafd8cfd fix(utils.py): support cache logging for async router calls 2023-12-13 19:11:43 -08:00
Krrish Dholakia
040c64d350 test(test_custom_callback_router.py): fix test 2023-12-13 19:06:02 -08:00
Krrish Dholakia
55147e3b27 docs(embedding.md): add embedding docs to proxy 2023-12-13 18:58:46 -08:00
Krrish Dholakia
853508e8c0 fix(utils.py): support caching for embedding + log cache hits
n

n
2023-12-13 18:37:30 -08:00
Krrish Dholakia
72b9d4c5e8 test(test_amazing_vertex_completion.py): fix testing 2023-12-13 16:41:26 -08:00
Krrish Dholakia
c673a23769 fix(vertex_ai.py): add exception mapping for acompletion calls 2023-12-13 16:35:50 -08:00
Krrish Dholakia
a825fb4010 fix(vertex.md): adding gemini-pro support to docs 2023-12-13 14:38:55 -08:00
Krrish Dholakia
2231601d5a fix(ollama.py): fix async completion calls for ollama 2023-12-13 13:10:25 -08:00
Krrish Dholakia
a17789e10d fix(factory.py): fix tgai rendering template 2023-12-13 12:27:31 -08:00
Krrish Dholakia
13a7f2dd58 fix(vertex_ai.py): add support for real async streaming + completion calls 2023-12-13 11:53:55 -08:00
Krrish Dholakia
f51d4ab26d fix(vertex_ai.py): support optional params + enable async calls for gemini 2023-12-13 11:01:23 -08:00
Krrish Dholakia
43b160d70d feat(vertex_ai.py): adds support for gemini-pro on vertex ai 2023-12-13 10:26:30 -08:00
Krrish Dholakia
56729cc1be fix(utils.py): fix stream chunk builder for sync/async success 2023-12-13 07:52:51 -08:00
Krrish Dholakia
3c399c425c fix(sagemaker.py): filter out templated prompt if in model response 2023-12-13 07:43:33 -08:00
Krrish Dholakia
f622718e28 fix(factory.py): safely fail prompt template get requests for together ai 2023-12-12 17:28:22 -08:00
Krrish Dholakia
8bb826975d feat(proxy_server.py): add new /key/update endpoint 2023-12-12 17:18:51 -08:00
Krrish Dholakia
c0d42ab5b1 test: refactor testing 2023-12-12 16:21:41 -08:00
Krrish Dholakia
d0e01d7e7a fix(utils.py): flush holding chunk for streaming, on stream end 2023-12-12 16:13:31 -08:00
Krrish Dholakia
e396fcb55c fix(main.py): pass user_id + encoding_format for logging + to openai/azure 2023-12-12 15:46:44 -08:00
Krrish Dholakia
9bbf1258f8 fix(utils.py): more logging 2023-12-12 15:46:27 -08:00
Krrish Dholakia
d059d1b101 fix(sagemaker.py): debug streaming 2023-12-12 15:45:07 -08:00
ishaan-jaff
1426978ad0 (ci/cd) run again 2023-12-12 12:22:14 -08:00
Krrish Dholakia
5dfa8488af bump: version 1.12.5.dev1 → 1.12.5 2023-12-12 11:11:09 -08:00
Krrish Dholakia
fa74447cc8 test: testing fixes 2023-12-12 10:57:51 -08:00
Krrish Dholakia
0cf0c2d6dd fix(router.py): deepcopy initial model list, don't mutate it 2023-12-12 09:54:06 -08:00
ishaan-jaff
ac91543848 (fix) test router 2023-12-12 09:50:44 -08:00
Krrish Dholakia
c476aacb47 test: reinitialize litellm before each test 2023-12-12 07:49:06 -08:00
Max Deichmann
d86bf1b906 fix langfuse tests 2023-12-12 12:00:41 +01:00
Krrish Dholakia
243b914965 test(test_streaming.py): stricter output format testing 2023-12-12 00:16:48 -08:00
ishaan-jaff
fc68c7b4f0 (test) reset callbacks in completion() 2023-12-11 23:35:52 -08:00
Krrish Dholakia
2c49bd4c60 test(test_streaming.py): add testing for azure output chunk 2023-12-11 23:32:38 -08:00
ishaan-jaff
9e09a888d1 (ci/cd) test 2023-12-11 23:22:40 -08:00
ishaan-jaff
0b0104cf87 (test) run ci/cd again 2023-12-11 23:17:23 -08:00
ishaan-jaff
f91beb0533 (test) stream - cache 2023-12-11 22:57:39 -08:00
ishaan-jaff
e418bc0a29 (test) custom logger + cache 2023-12-11 22:46:49 -08:00
ishaan-jaff
8db92f3238 (test) cleanup proxy 2023-12-11 22:41:14 -08:00