Krish Dholakia
e354840f90
Update README.md
2024-06-25 09:23:19 -07:00
Ishaan Jaff
39a2b41e16
Merge pull request #4401 from kiriloman/main
...
Fix Groq Prices
2024-06-25 08:56:07 -07:00
Kyrylo Yefimenko
8765e120f0
Fix Groq prices
2024-06-25 16:36:40 +01:00
Krish Dholakia
75c8f77d9a
Merge pull request #4373 from CorrM/main
...
[Fix-Improve] Improve Ollama prompt input and fix Ollama function calling key error
2024-06-25 06:27:43 -07:00
corrm
5b720137fd
Improve ollama prompt: this formula give good result with AutoGen
2024-06-25 13:53:27 +03:00
corrm
b69a092f56
Rename ollama prompt:
...
- 'Function' word to 'FunctionName'
- 'Tool Call' to `FunctionCall`
- 'Tool Call Result' to 'FunctionCall Result'
_I found that changes make some models better_
2024-06-25 12:40:07 +03:00
Krrish Dholakia
86cb5aa031
docs(routing.md): add quickstart
2024-06-24 22:25:39 -07:00
Krrish Dholakia
f8b390d421
fix(langfuse.py): cleanup
2024-06-24 21:43:40 -07:00
Ishaan Jaff
93dbdf6d92
bump: version 1.40.25 → 1.40.26
2024-06-24 21:15:36 -07:00
Ishaan Jaff
a9d1be71ff
Merge pull request #4395 from BerriAI/litelm_use_spend_calc_aliases
...
Fix /spend/calculate use model_group_alias when set
2024-06-24 21:15:05 -07:00
Ishaan Jaff
9e7d8ba910
/spend/calculate use model aliases on this endpoint
2024-06-24 21:14:00 -07:00
Krish Dholakia
9902947521
Merge pull request #4390 from BerriAI/litellm_langfuse_router_logging
...
Log rejected router requests to langfuse
2024-06-24 21:13:45 -07:00
Ishaan Jaff
a64d1de80f
test - aliases on /spend/calculate
2024-06-24 21:13:01 -07:00
Ishaan Jaff
7e5f200c6d
Merge pull request #4394 from BerriAI/docs_enterprise_control_routes
...
docs control available public routes
2024-06-24 20:57:00 -07:00
Ishaan Jaff
7f8c502a44
docs control available public routes
2024-06-24 20:54:43 -07:00
Ishaan Jaff
37f2712bba
Merge pull request #4389 from BerriAI/litellm_allow_user_to_define_public_routes
...
[Feat-Enterprise] - Allow setting custom public routes
2024-06-24 20:23:35 -07:00
Krish Dholakia
5d570e7c6c
Merge pull request #4392 from BerriAI/litellm_gemini_content_policy_errors
...
fix(vertex_httpx.py): cover gemini content violation (on prompt)
2024-06-24 20:00:06 -07:00
Ishaan Jaff
2aa0ce50b5
fix importing litellm
2024-06-24 19:58:53 -07:00
Ishaan Jaff
bd2298eba4
example cofnig with public routes
2024-06-24 19:51:23 -07:00
Ishaan Jaff
5e1403cd0a
add helper to check route_in_additonal_public_routes
2024-06-24 19:50:35 -07:00
Krrish Dholakia
d182ea0f77
fix(utils.py): catch 422-status errors
2024-06-24 19:41:48 -07:00
Ishaan Jaff
11117665e1
test - spend/calculate endpoints
2024-06-24 19:32:52 -07:00
Krish Dholakia
95f972ee9f
Merge pull request #4388 from BerriAI/litellm_custom_model_info
...
Support custom model info for router logic (e.g. `max_input_tokens`)
2024-06-24 19:31:37 -07:00
Krrish Dholakia
8e6e5a6d37
fix(vertex_httpx.py): Return empty model response for content filter violations
2024-06-24 19:22:20 -07:00
Krrish Dholakia
1ff0129a94
fix(vertex_httpx.py): cover gemini content violation (on prompt)
2024-06-24 19:13:56 -07:00
Ishaan Jaff
02ffed2545
feat - refactor /spend/calculate
2024-06-24 19:05:34 -07:00
Krrish Dholakia
a4bea47a2d
fix(router.py): log rejected router requests to langfuse
...
Fixes issue where rejected requests weren't being logged
2024-06-24 17:52:01 -07:00
Ishaan Jaff
5309be2456
example config with public routes
2024-06-24 17:46:38 -07:00
Ishaan Jaff
2f90759db5
feat - allow user to define public routes
2024-06-24 17:45:13 -07:00
Krrish Dholakia
341c7857c1
test(test_router.py): add testing
2024-06-24 17:28:12 -07:00
Krrish Dholakia
f5fbdf0fee
fix(router.py): use user-defined model_input_tokens for pre-call filter checks
2024-06-24 17:25:26 -07:00
Krrish Dholakia
123477b55a
fix(utils.py): fix exception_mapping check for errors
...
If exception already mapped - don't attach traceback to it
2024-06-24 16:55:19 -07:00
Ishaan Jaff
70a605b3cc
docs - update telemetry
2024-06-24 13:21:16 -07:00
Ishaan Jaff
dd048cf342
Merge pull request #4382 from BerriAI/litellm_ui_fix_login_bug
...
[Fix] - Admin UI login bug
2024-06-24 08:19:37 -07:00
Ishaan Jaff
bd160745f9
Merge pull request #4379 from 7HR4IZ3/main
...
fix: Lunary integration
2024-06-24 08:11:19 -07:00
Ishaan Jaff
acbcfef5af
fix ui login bug
2024-06-24 07:54:08 -07:00
7HR4IZ3
515dc9acc7
fix: Lunary integration
...
Fixes the bug of litellm not logging system messages to lunary
2024-06-24 14:09:40 +01:00
Islam Nofl
e2af13550a
Rename ollama prompt 'Function' word to 'Name'
2024-06-24 08:01:15 +03:00
corrm
b8a8b0847c
Added improved function name handling in ollama_async_streaming
2024-06-24 05:56:56 +03:00
corrm
423a60c8bc
chore: Improved OllamaConfig get_required_params and ollama_acompletion and ollama_async_streaming functions
2024-06-24 05:55:22 +03:00
corrm
b2c1a3ad79
chore: Improved prompt generation in ollama_pt function
2024-06-24 05:54:58 +03:00
Krrish Dholakia
769c60e4f6
test: skip unstable tests
2024-06-23 00:30:45 -07:00
Krrish Dholakia
3d09a196a4
test(test_completion.py): handle replicate api error
2024-06-23 00:06:15 -07:00
Krrish Dholakia
9cff2b03f3
test(test_proxy_server_langfuse.py): cleanup tests causing OOM issues.
2024-06-22 23:53:18 -07:00
Krrish Dholakia
d857d82b0e
fix(redact_messages.py): fix pr
2024-06-22 23:27:13 -07:00
Krrish Dholakia
9450d2cf77
fix(test_dynamic_rate_limit_handler.py): cleanup
2024-06-22 22:43:56 -07:00
Krrish Dholakia
dc43ffb771
fix(redact_messages.py): fix get
2024-06-22 21:57:54 -07:00
Krrish Dholakia
4d9a0d45b2
docs(team_budgets.md): cleanup docs
2024-06-22 21:38:01 -07:00
Krrish Dholakia
bf12536fdb
bump: version 1.40.24 → 1.40.25
2024-06-22 21:34:55 -07:00
Krish Dholakia
9bffa9a48e
Merge pull request #4352 from msabramo/msabramo/turn-on-message-logging-via-request-header
...
Disable message redaction in logs via request header
2024-06-22 21:30:41 -07:00
