Commit graph

2876 commits

Author SHA1 Message Date
Krrish Dholakia
1a7a7b0cc1 refactor(proxy_server.py): make print statements into print_verbose 2023-12-28 15:08:23 +05:30
Krrish Dholakia
f3846d4c30 refactor(proxy_server.py): move admin ui to be locally hosted within proxy 2023-12-28 15:06:32 +05:30
ishaan-jaff
cc1133d0cb (docs) proxy - swagger docs, add tags for model/info 2023-12-28 13:13:04 +05:30
ishaan-jaff
e1ce865dbc (fix) proxy - raise error when user missing litellm[proxy] 2023-12-28 13:07:44 +05:30
Krrish Dholakia
9f056c91bd test(test_proxy_custom_logger.py): fix testing to handle [done] chunks 2023-12-28 11:37:57 +05:30
Krrish Dholakia
b20bbaf96d fix(proxy_server.py): return [DONE] end of stream chunk 2023-12-28 11:30:49 +05:30
Krrish Dholakia
507b6bf96e fix(utils.py): use local tiktoken copy 2023-12-28 11:22:33 +05:30
ishaan-jaff
090bc361d8 (ci/cd) run render deploy 2023-12-28 11:16:58 +05:30
Krrish Dholakia
998ca2d000 test(test_health_check.py): fix azure embedding health check test 2023-12-28 10:48:31 +05:30
Krrish Dholakia
2285282ef8 feat(health_check.py): more detailed health check calls 2023-12-28 09:12:57 +05:30
ishaan-jaff
9214cc913b (test) proxy - debug /health 2023-12-27 19:18:41 +05:30
ishaan-jaff
a27ba3fd69 (test) langfuse - mark beta test 2023-12-27 18:43:49 +05:30
ishaan-jaff
db80d4f1a6 (ci/cd) move langfuse test early 2023-12-27 17:50:44 +05:30
ishaan-jaff
914111b525 (test) langfuse logging 2023-12-27 17:50:05 +05:30
ishaan-jaff
3ea4eb2fc6 (feat) proxy - remove appdirs 2023-12-27 17:40:05 +05:30
ishaan-jaff
eba2969bff (fix) proxy - remove bloat - deprecated log_input_output 2023-12-27 17:36:53 +05:30
ishaan-jaff
636920c128 (feat) proxy remove appdirs as a dep 2023-12-27 17:33:47 +05:30
ishaan-jaff
2988cb0292 (feat) proxy - remove subprocess install 2023-12-27 17:28:03 +05:30
Krrish Dholakia
606de01ac0 fix(utils.py): allow text completion input to be either model or engine 2023-12-27 17:24:16 +05:30
ishaan-jaff
5f9e18c4c0 (fix) openai + stream - logprobs check 2023-12-27 16:59:56 +05:30
Krrish Dholakia
2af635e9fd test(test_router_fallbacks.py): fix test to check previous models in pre_api_call not on success 2023-12-27 16:34:40 +05:30
ishaan-jaff
9d78f4b1ce (test) langfuse beta test - text_completion 2023-12-27 15:45:40 +05:30
ishaan-jaff
3d2049a9f0 (test) gpt-3.5-turbo-instruct finish reason 2023-12-27 15:45:40 +05:30
ishaan-jaff
c65d9a8b54 (feat) text-completion-openai, send 1 finish_reason 2023-12-27 15:45:40 +05:30
Krrish Dholakia
db6ef70a68 fix(azure.py): raise streaming exceptions 2023-12-27 15:43:13 +05:30
ishaan-jaff
1100993834 (fix) use client for text_completion() 2023-12-27 15:20:26 +05:30
ishaan-jaff
592bcd5eea (fix) text_completion use correct finish reason 2023-12-27 15:20:26 +05:30
ishaan-jaff
dae379b052 (test) fix langfuse test 2023-12-27 15:20:26 +05:30
Krrish Dholakia
517b22604b test(test_router_fallbacks.py): add testing for sync streaming fallbacks 2023-12-27 15:10:43 +05:30
Krrish Dholakia
fd5e6efb1d fix(azure.py,-openai.py): correctly raise errors if streaming calls fail 2023-12-27 15:08:37 +05:30
Krrish Dholakia
85549c3d66 fix(google_kms.py): support enums for key management system 2023-12-27 13:19:33 +05:30
ishaan-jaff
021d7fab65 (feat) add text_completion, atext_completion CallTypes 2023-12-27 12:24:16 +05:30
Krrish Dholakia
2269f01c17 fix: fix linting issues 2023-12-27 12:21:31 +05:30
Krish Dholakia
fabfe42af3 Merge pull request #1248 from danikhan632/main
updated oobabooga to new api and support for embeddings
2023-12-27 11:33:56 +05:30
Ishaan Jaff
daead14f0c Merge pull request #1249 from evantancy/main
fix: helicone logging
2023-12-27 11:24:19 +05:30
evantancy
09d3972b64 fix: helicone logging 2023-12-27 12:16:29 +08:00
dan
c7be18cf46 updated oobabooga to new api and support for embeddings 2023-12-26 19:45:28 -05:00
ishaan-jaff
48eee4e0c2 (test) local ollama_chat 2023-12-26 20:11:14 +05:30
ishaan-jaff
c9be1cfcb1 (fix) ollama_chat - support function calling + fix for comp 2023-12-26 20:07:55 +05:30
ishaan-jaff
b91344e9e7 (test) ollama_chat acompletion without stream 2023-12-26 20:01:51 +05:30
ishaan-jaff
4233e42f5d (feat) ollama_chat acompletion without streaming 2023-12-26 20:01:51 +05:30
ishaan-jaff
eb49826e4e (fix) support ollama_chat for acompletion 2023-12-26 20:01:51 +05:30
Krrish Dholakia
6bd6d68990 feat(proxy_server.py): support maxage cache control 2023-12-26 17:50:27 +05:30
Krrish Dholakia
b25a8c3b42 fix(main.py): support ttl being set for completion, embedding, image generation calls 2023-12-26 17:22:40 +05:30
Krrish Dholakia
4500831891 refactor(google_kms.py): fix linting issue 2023-12-26 16:21:35 +05:30
ishaan-jaff
99c86bf890 (fix) streaming logprobs=None 2023-12-26 15:42:51 +05:30
Krrish Dholakia
6f695838e5 feat(utils.py): support google kms for secret management
https://github.com/BerriAI/litellm/issues/1235
2023-12-26 15:39:40 +05:30
ishaan-jaff
c95a0cdcc0 (test) azure gpt-vision 2023-12-26 15:24:20 +05:30
ishaan-jaff
f6f552be6e (test) stream + logprobs openai 2023-12-26 15:15:37 +05:30
ishaan-jaff
9c6525e4e2 (feat) logprobs for streaming openai 2023-12-26 15:15:05 +05:30