Commit graph

2575 commits

Author SHA1 Message Date
Krrish Dholakia
aa57c63091 build(openai_proxy): docker build fixes 2023-10-25 13:34:04 -07:00
Krish Dholakia
81349f3025
Update README.md 2023-10-25 13:31:57 -07:00
ishaan-jaff
8870d6c4b8 (fix) proxy server importing utils 2023-10-25 12:16:03 -07:00
ishaan-jaff
5bd1b3968e (feat) Redis caching print exception statements when it fails 2023-10-25 11:29:48 -07:00
ishaan-jaff
7f7802ec1b (test) proxy server update caching tests 2023-10-25 11:29:48 -07:00
ishaan-jaff
e7eb495a3a (docs) proxy add info on testing caching 2023-10-25 11:29:48 -07:00
ishaan-jaff
907bff33f0 (feat) openai-proxy add print statements letting users know which callback is switched on 2023-10-25 11:29:48 -07:00
Krrish Dholakia
e118ce50e1 build(openai_proxy/main.py): fixing model list 2023-10-25 11:23:02 -07:00
Krish Dholakia
751e9f07f3
Update Dockerfile 2023-10-25 11:16:17 -07:00
Krrish Dholakia
b9a4bfc054 build(openai_proxy/main.py): adding support for routing between multiple azure deployments 2023-10-25 11:16:02 -07:00
ishaan-jaff
f208a1231b (docs) proxy server add info on caching 2023-10-25 10:38:58 -07:00
ishaan-jaff
1d910cd280 (feat) proxy_server add redis as a dep 2023-10-25 10:29:36 -07:00
ishaan-jaff
ba106a776b (docs) openapi.json fix ChatCompletion Response output 2023-10-25 10:18:59 -07:00
ishaan-jaff
474825210a (docs) proxy server add openapi spec 2023-10-25 10:12:48 -07:00
Krrish Dholakia
edfa4d550a docs(anyscale.md): adding anyscale documentation
n
2023-10-25 09:12:29 -07:00
Krrish Dholakia
c1b2553827 fix(utils.py): adding support for anyscale models 2023-10-25 09:08:10 -07:00
ishaan-jaff
9714b85cac (feat) proxy add openapi.json 2023-10-25 08:47:29 -07:00
Krish Dholakia
92e240e474
Update model_prices_and_context_window.json 2023-10-25 08:30:47 -07:00
Krish Dholakia
4e3ca95a72
Merge pull request #695 from SlapDrone/set-langfuse-release 2023-10-25 08:18:51 -07:00
Liam Moore
fe2b214b7a support release and debug params for langfuse client 2023-10-25 16:12:14 +02:00
ishaan-jaff
7b76a7ed25 (docs) on deploying render 2023-10-24 21:28:37 -07:00
ishaan-jaff
e897a75887 (docs) simple proxy testing 2023-10-24 21:13:41 -07:00
ishaan-jaff
923bc706fd (docs) simple proxy server 2023-10-24 21:00:01 -07:00
ishaan-jaff
70fcf351d8 (docs) simple proxy updates 2023-10-24 20:55:15 -07:00
ishaan-jaff
55b9fb6bfb (docs) add deploy to render litellm 2023-10-24 20:40:52 -07:00
Ishaan Jaff
bbec65449d
Merge pull request #691 from mc-marcocheng/router/aembedding
Router aembedding
2023-10-24 20:27:46 -07:00
mc-marcocheng
bf98d48bba Feature: Router aembedding 2023-10-25 11:19:45 +08:00
Krrish Dholakia
046e1384c3 docs(huggingface.md): adding huggingface text-embedding-inference to docs 2023-10-24 17:53:39 -07:00
Krrish Dholakia
822b0b55e8 build(openai-proxy/main.py): adding embedding endpoint 2023-10-24 17:44:40 -07:00
ishaan-jaff
749c7ea73d (test) test custom input_callback 2023-10-24 17:40:59 -07:00
ishaan-jaff
e5c6f512f9 (docs) show how to set custom input_callback 2023-10-24 17:40:59 -07:00
Krish Dholakia
b86c679e71
Merge pull request #647 from nirga/traceloop-bug
fix: bugs in traceloop integration
2023-10-24 17:38:30 -07:00
Krrish Dholakia
54beb0f953 bump: version 0.12.4 → 0.12.5 2023-10-24 17:20:31 -07:00
Krrish Dholakia
0f08335edd fix(router.py): adding support for async completion calls
https://github.com/BerriAI/litellm/issues/676
2023-10-24 17:20:31 -07:00
ishaan-jaff
30dd0b5c6b (docs) proxy server title 2023-10-24 17:14:57 -07:00
Krrish Dholakia
59ddda5c4b docs(token_usage.md): adding registering model via url to docs 2023-10-24 16:21:38 -07:00
ishaan-jaff
b3dc1eccc3 (fix) utils.token trimming ensure new length always greater than 0 2023-10-24 16:03:11 -07:00
ishaan-jaff
81ce24b96e (fix) utils.token trimming, hanging for large messages 2023-10-24 16:03:11 -07:00
Krrish Dholakia
24c1207451 docs(proxy_server.md): cli tool deprecation notice 2023-10-24 16:01:05 -07:00
Krrish Dholakia
f967d6af5e fix(init.py): fix linting errors 2023-10-24 15:54:21 -07:00
Krish Dholakia
b68f083e10
Merge pull request #678 from coconut49/main
Updating the docker image builder for GitHub Action
2023-10-24 15:52:08 -07:00
Krrish Dholakia
992216972f bump: version 0.12.4.dev2 → 0.12.4 2023-10-24 15:38:10 -07:00
Krrish Dholakia
5c8a4f51d5 fix(utils.py): allow url to be passed to model cost map 2023-10-24 15:38:05 -07:00
Krrish Dholakia
cb100d19da test(test_batch_completion.py): cleanup tests 2023-10-24 15:09:51 -07:00
Krrish Dholakia
3ec103f712 test(test_caching.py): reset to none 2023-10-24 15:02:20 -07:00
Ishaan Jaff
029084ccb8
Update README.md 2023-10-24 12:59:53 -07:00
Krrish Dholakia
1eca893d2f test(test_async_fn.py): adding additional logging for tests 2023-10-24 12:54:18 -07:00
ishaan-jaff
f9ff8cbfb1 (docs) update cloud run deploy link 2023-10-24 12:53:23 -07:00
Ishaan Jaff
dd88adc2ba
(docs) readme links 2023-10-24 12:49:07 -07:00
Krrish Dholakia
2c371bb8d1 refactor(test_async_fn.py): refactor for testing 2023-10-24 12:46:30 -07:00