Commit graph

5911 commits

Author SHA1 Message Date
Krrish Dholakia
09b7235b31 fix: support info level logging on pkg + proxy 2024-01-20 17:45:47 -08:00
Krrish Dholakia
3e5b743b89 fix(caching.py): add logging module support for caching 2024-01-20 17:34:29 -08:00
Ishaan Jaff
d60af6fff5
Merge pull request #1535 from kihaya/docs/fix_sample_code_import_for_providers
docs: Fix import statement for provider's sample code
2024-01-20 08:42:42 -08:00
Kihaya Sugiura
82449ffcfd
docs: Fix import 2024-01-20 19:15:07 +09:00
Kihaya Sugiura
c550357199
docs: Fix import 2024-01-20 19:13:33 +09:00
ishaan-jaff
ab60f071ff bump: version 1.18.7 → 1.18.8 2024-01-19 20:50:00 -08:00
Ishaan Jaff
435d4b9279
Merge pull request #1534 from BerriAI/litellm_custom_cooldown_times
[Feat] Litellm.Router set custom cooldown times
2024-01-19 20:49:17 -08:00
ishaan-jaff
5295168bda (docs) router 2024-01-19 20:46:43 -08:00
ishaan-jaff
ccbc47122c (fix) test caching 2024-01-19 20:45:10 -08:00
Krrish Dholakia
1cdf3baf3d bump: version 1.18.6 → 1.18.7 2024-01-19 20:31:12 -08:00
ishaan-jaff
84684c50fa (fix) router - timeout exception mapping 2024-01-19 20:30:41 -08:00
Krrish Dholakia
7cf0bb475f fix(proxy_server.py): run all endpoints through custom auth 2024-01-19 20:24:33 -08:00
Krrish Dholakia
b07677c6be fix(gemini.py): support streaming 2024-01-19 20:21:34 -08:00
Ishaan Jaff
b59e67f099
Merge pull request #1529 from BerriAI/litellm_router_add_type_hints
[Feat] Add typehints for litellm.Router
2024-01-19 19:45:54 -08:00
ishaan-jaff
16b688d1ff (feat) router - set custom cooldown times 2024-01-19 19:43:41 -08:00
ishaan-jaff
0fa9d8af82 (test) custom cooldown times - router 2024-01-19 19:41:52 -08:00
Krish Dholakia
749f0b7602
Merge pull request #1531 from BerriAI/litellm_max_parallel_request_invalid_provider_fix
fix(utils.py): add metadata to logging obj on setup, if exists (fixes max parallel request bug)
2024-01-19 19:25:34 -08:00
Krrish Dholakia
2c2163e4e5 fix(proxy_server.py): fix key info to handle pydantic v1 2024-01-19 18:52:09 -08:00
Krrish Dholakia
f2a8ceddc2 fix(utils.py): revert exception mapping change 2024-01-19 17:39:35 -08:00
Krrish Dholakia
f05aba1f85 fix(utils.py): add metadata to logging obj on setup, if exists 2024-01-19 17:29:47 -08:00
Krrish Dholakia
1ec5083542 fix(anthropic.py): fix pr for anthropic headers 2024-01-19 17:06:24 -08:00
Krrish Dholakia
1be4f7d2d1 fix(test_key_generate_prisma.py): fix testing
n
2024-01-19 16:53:46 -08:00
ishaan-jaff
91e57bd039 (fix) add router typehints 2024-01-19 16:32:43 -08:00
ishaan-jaff
a9cf6cec80 (feat) add typehints for litellm.acompletion 2024-01-19 16:05:26 -08:00
ishaan-jaff
b730482aaf v0 2024-01-19 15:49:37 -08:00
Ishaan Jaff
6134b655e8
Merge pull request #1513 from costly-ai/main
Allow overriding headers for anthropic
2024-01-19 15:21:45 -08:00
ishaan-jaff
6bc7cc46b4 (docs) router debugging 2024-01-19 15:18:00 -08:00
Krrish Dholakia
95d1557785 build(config.yml): fix envrionment variable name 2024-01-19 15:11:18 -08:00
Krrish Dholakia
89391f84eb build(config.yml): add better logs 2024-01-19 15:08:32 -08:00
ishaan-jaff
22daf75a35 bump: version 1.18.5 → 1.18.6 2024-01-19 15:03:30 -08:00
Ishaan Jaff
73684bc93f
Merge pull request #1525 from BerriAI/litellm_router_improvements
[Feat] Router improvements
2024-01-19 15:02:05 -08:00
ishaan-jaff
8a4f2c198b (test) test_usage_based_routing 2024-01-19 14:59:56 -08:00
Krrish Dholakia
f5ced089d6 test(tests/): add unit testing for proxy server endpoints 2024-01-19 14:54:29 -08:00
ishaan-jaff
f408162449 (test) debug logs test - router 2024-01-19 14:22:18 -08:00
ishaan-jaff
0196ac6376 (test) router-fallbacks 2024-01-19 14:12:09 -08:00
Ishaan Jaff
b2b41727ce
Merge pull request #1524 from timothyasp/langsmith-project-env-bug-fix
Langsmith: Add envs for project/run names; fix bug with None metadata
2024-01-19 14:04:16 -08:00
ishaan-jaff
d0442ae0f2 (feat) router - usage based routing - consider input_tokens 2024-01-19 13:59:49 -08:00
ishaan-jaff
57a20100e4 (test) usage based routing 2024-01-19 13:58:08 -08:00
ishaan-jaff
8c0b7b1015 (feat) - improve router logging/debugging messages 2024-01-19 13:57:33 -08:00
ishaan-jaff
912e2de364 (test) usage based router + fallbacks 2024-01-19 12:34:08 -08:00
ishaan-jaff
7b2c15aa51 (feat) improve litellm.Router logging 2024-01-19 12:28:51 -08:00
Tim Asp
9d6a8b5de3 Cleaner fallback 2024-01-19 11:56:45 -08:00
Ishaan Jaff
650036071f
Merge pull request #1519 from BerriAI/litellm_proxy_make_success_handler_non_blocking
[Feat] litellm.acompletion() make Langfuse success handler non blocking
2024-01-19 11:41:00 -08:00
Tim Asp
315fbcd09f update docs 2024-01-19 11:39:39 -08:00
ishaan-jaff
8cf8da1378 (test) langfuse_latency_test_user 2024-01-19 11:38:44 -08:00
ishaan-jaff
cb99cd18e7 (feat) log cache_hit as langfuse tags 2024-01-19 11:38:18 -08:00
Tim Asp
27087e5662 fix error when metadata is none, prevents logging silently 2024-01-19 11:37:45 -08:00
Tim Asp
141d2219e2 Add env for project wide langsmith default project settings 2024-01-19 11:37:15 -08:00
ishaan-jaff
2f429f37b7 (test) test latency added with langfuse call 2024-01-19 11:28:10 -08:00
ishaan-jaff
cb40f58cd3 (fix) return usage in mock_completion 2024-01-19 11:25:47 -08:00