Commit graph

1179 commits

Author SHA1 Message Date
Krrish Dholakia
b20cf3171b feat(router.py): add routing capabilities for multiple deployments 2023-10-17 22:28:31 -07:00
ishaan-jaff
da3625e2f3 (fix) linting fix for wandb logger 2023-10-17 18:06:14 -07:00
ishaan-jaff
46cd3cb7a4 (test) wandb logger 2023-10-17 18:04:55 -07:00
ishaan-jaff
b6b9f9487d (test) add weights & biases logger 2023-10-17 18:01:53 -07:00
ishaan-jaff
5fd7720029 (feat) weights & biases logger 2023-10-17 18:01:53 -07:00
Krrish Dholakia
a7c3fc2fd9 fix(utils.py): mapping azure api version missing exception 2023-10-17 17:12:51 -07:00
Krrish Dholakia
b67fe857dd test(test_proxy.py): add tests for debugging 2023-10-17 16:47:48 -07:00
Krrish Dholakia
22937b3b16 test(test_proxy.py): adding testing for proxy server 2023-10-17 16:29:11 -07:00
Krrish Dholakia
450f6edce8 fix(proxy_server.py): putting load config in a try-except block 2023-10-17 13:45:35 -07:00
Krrish Dholakia
e0ae2c5d68 fix(proxy_server.py): add backoff to install 2023-10-17 13:42:57 -07:00
Krrish Dholakia
2f57dc8906 refactor(proxy_cli.py): code cleanup 2023-10-17 13:29:47 -07:00
Krrish Dholakia
e34e6429a7 refactor(llm.py): fixes linting issues 2023-10-17 13:07:21 -07:00
ishaan-jaff
4cccad35f4 (feat) bump langfuse logger, track function responses, completion() metadata like temp, max_tokens etc 2023-10-17 11:51:05 -07:00
coconut49
356a10431d
Add new routes for v1 versioning in proxy server 2023-10-18 01:54:47 +08:00
coconut49
db55dac434
merge 2023-10-18 01:47:56 +08:00
coconut49
07f06c6479
Refactor Dockerfile and proxy_cli.py to use new secrets file location 2023-10-18 01:17:03 +08:00
coconut49
0939302ae9
Refactor proxy_server.py to simplify v1 endpoints and improve logging 2023-10-18 00:35:51 +08:00
Krrish Dholakia
dcb866b353 docs(proxy_server.md): update proxy server docs to include multi-agent autogen tutorial 2023-10-17 09:22:34 -07:00
coconut49
4414594e7d
Refactor proxy_server.py for readability and code consistency 2023-10-17 23:48:55 +08:00
coconut49
e8a56819cf
Refactor start script and Dockerfile, switch to bash entrypoint 2023-10-17 22:53:06 +08:00
coconut49
2039066aa1
Remove all __pycache__ directories 2023-10-17 22:40:59 +08:00
coconut49
5c1a460fd5
rm litellm/__pycache__/ 2023-10-17 22:36:06 +08:00
ishaan-jaff
205f4a59e9 (test) langfuse updates 2023-10-16 21:42:01 -07:00
ishaan-jaff
730ee6a7ae (test) langfuse logging with custom gen name 2023-10-16 21:34:44 -07:00
ishaan-jaff
5135b77c43 (feat) langfuse logging set custom generation_name 2023-10-16 21:34:01 -07:00
ishaan-jaff
6950e10a49 (test) update langchain tests 2023-10-16 20:24:10 -07:00
Krrish Dholakia
541a8b7bc8 fix(proxy_server): improve error handling 2023-10-16 19:42:53 -07:00
Krrish Dholakia
036c50e2bf refactor(main.py): clean up print statement 2023-10-16 17:53:09 -07:00
Krrish Dholakia
7572086231 style: fix linting errors 2023-10-16 17:35:08 -07:00
Krrish Dholakia
5ef054f105 refactor(proxy_server.py): code cleanup 2023-10-16 16:47:33 -07:00
Krrish Dholakia
81373f0678 build: Adds dockerfile for easily building proxy 2023-10-16 15:09:29 -07:00
Krrish Dholakia
4424aaf69f refactor(main.py): remove print statement 2023-10-16 07:33:15 -07:00
Krrish Dholakia
1a09bbd4a9 docs(main.py): adding docstring for text_completion 2023-10-16 07:31:48 -07:00
Zeeland
9f6138ef0e fix: llm_provider add openai finetune compatibility 2023-10-16 18:44:45 +08:00
canada4663
98abecf124 remove duplicate entry for bedrock in provider list 2023-10-14 21:44:16 -07:00
canada4663
4b52bd955c updated proxy_server.py /models endpoint with the results of get_valid_models() 2023-10-14 20:54:47 -07:00
ishaan-jaff
7848f1b5b7 (feat) new function_to_dict litellm.util 2023-10-14 18:26:15 -07:00
ishaan-jaff
02e97acefa (test) deep infra testing for mistral 2023-10-14 16:47:25 -07:00
ishaan-jaff
8f0dd53079 (fix) handle deepinfra/mistral temp for mistral 2023-10-14 16:47:25 -07:00
ishaan-jaff
6413285551 (fix) deepinfra/llama should go to deepinfra not to openrouter 2023-10-14 16:47:25 -07:00
Krrish Dholakia
7358d2e4ea bump: version 0.8.4 → 0.8.5 2023-10-14 16:43:06 -07:00
canada4663
4411fd3872
Update __init__.py model_list to include bedrock models 2023-10-14 16:29:18 -07:00
ishaan-jaff
97fc44db53 (feat) add doc string for litellm.utils 2023-10-14 16:12:21 -07:00
ishaan-jaff
69065e9864 (feat) add docstring for caching 2023-10-14 16:08:42 -07:00
ishaan-jaff
882ac46727 (feat) add doc string for embedding 2023-10-14 16:08:13 -07:00
ishaan-jaff
a86a140556 (feat) add swagger docs to cli config 2023-10-14 12:32:33 -07:00
ishaan-jaff
b6a015404e (feat) proxy_cli cleanup 2023-10-14 12:19:56 -07:00
Krrish Dholakia
d6f2d9b9bb docs(custom_callback.md): add details on what kwargs are passed to custom callbacks 2023-10-14 11:29:26 -07:00
Krrish Dholakia
fc757dc1b4 docs(proxy_server.md): add logs, save keys, model fallbacks, config file template to proxy server docs 2023-10-14 10:52:01 -07:00
Krrish Dholakia
9513d6b862 fix(utils.py): read env variables for known openai-compatible api's (e.g. perplexity), dynamically from th eenvironment 2023-10-13 22:43:32 -07:00