Commit graph

3222 commits

Author SHA1 Message Date
ishaan-jaff
0b0d22d58c (feat) add logprobs, top_logprobs to litellm.completion 2023-12-26 13:39:48 +05:30
ishaan-jaff
ae074814c9 (test) azure gpt-4 vision test 2023-12-26 13:18:38 +05:30
Krrish Dholakia
f5ed4992db fix(router.py): accept dynamic api key 2023-12-26 13:16:22 +05:30
ishaan-jaff
d273d19bd9 (feat) proxy, use --model with --test 2023-12-26 09:40:58 +05:30
ishaan-jaff
2d5801b69e (feat) add langfuse logging tests to ci/cd 2023-12-26 09:16:13 +05:30
ishaan-jaff
18676bb560 (fix) langfuse - asycn logger 2023-12-26 08:49:49 +05:30
ishaan-jaff
3f15d7230f (test) ollama cht 2023-12-26 00:08:35 +05:30
ishaan-jaff
b9123a63fa bump: version 1.15.7 → 1.15.8 2023-12-26 00:07:57 +05:30
ishaan-jaff
2690fe6dca (test) ollama-chat 2023-12-25 23:59:24 +05:30
ishaan-jaff
837ce269ae (feat) ollama_chat add async stream 2023-12-25 23:45:27 +05:30
ishaan-jaff
aea7faa2c1 (feat) ollama_chat - add async streaming 2023-12-25 23:45:01 +05:30
ishaan-jaff
67ed1ee10e (feat) add ollama_chat exception mapping 2023-12-25 23:43:14 +05:30
ishaan-jaff
f27a93a4dc (feat) ollama_chat - streaming 2023-12-25 23:38:47 +05:30
ishaan-jaff
916ba9a6b3 (feat) ollama_chat - add streaming support 2023-12-25 23:38:01 +05:30
ishaan-jaff
fa305054be (test) ollama chat 2023-12-25 23:04:17 +05:30
ishaan-jaff
d3baab3bbb utils - convert ollama_chat params 2023-12-25 23:04:17 +05:30
ishaan-jaff
8c35aebdf8 (feat) ollama chat 2023-12-25 23:04:17 +05:30
ishaan-jaff
3e97a766a6 (feat) add ollama_chat as a provider 2023-12-25 23:04:17 +05:30
ishaan-jaff
03de92eec0 (feat) ollama/chat 2023-12-25 23:04:17 +05:30
ishaan-jaff
d85c19394f (feat) ollama use /api/chat 2023-12-25 14:29:10 +05:30
ishaan-jaff
da4ec6c8b6 (feat) add ollama_chat v0 2023-12-25 14:27:10 +05:30
Krrish Dholakia
4905929de3 refactor: add black formatting 2023-12-25 14:11:20 +05:30
ishaan-jaff
b87d630b0a (test) ollama json mode 2023-12-25 14:00:56 +05:30
Krrish Dholakia
b3a98d8400 fix(proxy_server.py): accept keys with none duration 2023-12-25 13:46:24 +05:30
Krrish Dholakia
9f79f75635 fix(proxy/utils.py): return different exceptions if key is invalid vs. expired
https://github.com/BerriAI/litellm/issues/1230
2023-12-25 10:29:44 +05:30
Krrish Dholakia
402b2e5733 build(test_streaming.py): fix linting issues 2023-12-25 07:34:54 +05:30
Krrish Dholakia
343a06fd84 fix(proxy_server.py): raise streaming exceptions 2023-12-25 07:18:09 +05:30
Krrish Dholakia
1262d89ab3 feat(gemini.py): add support for completion calls for gemini-pro (google ai studio) 2023-12-24 09:42:58 +05:30
Krrish Dholakia
eaaad79823 feat(ollama.py): add support for async ollama embeddings 2023-12-23 18:01:25 +05:30
Krrish Dholakia
39a722bc9b fix(test_azure_perf.py): fix linting 2023-12-23 13:25:00 +05:30
Krrish Dholakia
05f8d11346 test(test_azure_perf.py): add perf testing for azure router streaming 2023-12-23 13:20:19 +05:30
Krrish Dholakia
b4b4a7d43a Revert "test(test_azure_perf.py): add perf testing for router streaming"
This reverts commit 4fa7f19888.
2023-12-23 13:19:07 +05:30
Krrish Dholakia
4fa7f19888 test(test_azure_perf.py): add perf testing for router streaming 2023-12-23 13:16:49 +05:30
Krrish Dholakia
49932ac90a test: skip flaky tests 2023-12-23 12:37:38 +05:30
Krrish Dholakia
e620d2f219 fix(utils.py): log user_id to langfuse 2023-12-23 12:14:09 +05:30
Krish Dholakia
2df5ce4b7c
Merge pull request #1182 from sumanth13131/usage-based-routing-fix
usage_based_routing_fix
2023-12-23 11:50:34 +05:30
Krish Dholakia
d195787db7
Merge pull request #1183 from maxdeichmann/improve-langchain-integration
Improve langfuse integration
2023-12-23 11:47:36 +05:30
Krish Dholakia
710c809478
Merge pull request #1195 from AllentDan/fix-routing
fix least_busy router by updating min_traffic
2023-12-23 11:45:35 +05:30
Krish Dholakia
03fd5da5ae
Merge pull request #1203 from Manouchehri/bedrock-cloudflare-ai-gateway-1
Add aws_bedrock_runtime_endpoint support
2023-12-23 11:44:04 +05:30
Krish Dholakia
8afdc12918
Merge pull request #1211 from sihyeonn/fix/sh-success-callback
fix: success_callback logic for cost_tracking
2023-12-23 11:41:30 +05:30
Krish Dholakia
81617534b6
Merge pull request #1213 from neubig/vertex_chat_generate_content
Make vertex ai work with generate_content
2023-12-23 11:40:43 +05:30
Krrish Dholakia
79a79b16e1 bump: version 1.15.6 → 1.15.7 2023-12-23 10:03:49 +05:30
Krrish Dholakia
43f4096014 fix(langsmith.py): fix langsmith streaming logging 2023-12-23 10:02:35 +05:30
Krrish Dholakia
89ee9fe400 fix(proxy_server.py): manage budget at user-level not key-level
https://github.com/BerriAI/litellm/issues/1220
2023-12-22 15:10:38 +05:30
Krrish Dholakia
979575a2a6 fix(proxy_server.py): handle misformatted json body in chat completion request 2023-12-22 12:30:36 +05:30
Krrish Dholakia
1e526c7e06 bump: version 1.15.5 → 1.15.6 2023-12-22 12:24:20 +05:30
Krrish Dholakia
f1270a7c78 fix(utils.py): handle ollama yielding a dict 2023-12-22 12:23:42 +05:30
Krrish Dholakia
eb2d13e2fb test(test_completion.py-+-test_streaming.py): add ollama endpoint to ci/cd pipeline 2023-12-22 12:21:33 +05:30
Krrish Dholakia
57607f111a fix(ollama.py): use litellm.request timeout for async call timeout 2023-12-22 11:22:24 +05:30
Krrish Dholakia
278f61f3ed fix(utils.py): handle 'os.environ/' being passed in as kwargs 2023-12-22 11:08:44 +05:30