Ishaan Jaff
22b7c0333d
docs - add nvidia nim
2024-06-27 20:20:30 -07:00
Ishaan Jaff
ee0d8341b0
test - nvidia nim
2024-06-27 20:20:30 -07:00
Ishaan Jaff
a9f17d141c
feat - add param mapping for nvidia nim
2024-06-27 20:20:30 -07:00
Ishaan Jaff
11ea1474b1
feat - add nvidia nim to main.py
2024-06-27 20:20:30 -07:00
Ishaan Jaff
b55c31ec3f
add nvidia nim to __init__
2024-06-27 20:20:30 -07:00
Ishaan Jaff
e471aca81f
feat - add debug_utils
2024-06-27 20:20:30 -07:00
Krish Dholakia
c18b8bb011
Update README.md
2024-06-27 20:20:30 -07:00
Krish Dholakia
43e42389d7
Update README.md
2024-06-27 20:20:30 -07:00
Kyrylo Yefimenko
1946610efd
Fix Groq prices
2024-06-27 20:20:30 -07:00
corrm
2e7b0096d0
Improve ollama prompt: this formula give good result with AutoGen
2024-06-27 20:20:30 -07:00
corrm
ec36dd40d7
Rename ollama prompt:
...
- 'Function' word to 'FunctionName'
- 'Tool Call' to `FunctionCall`
- 'Tool Call Result' to 'FunctionCall Result'
_I found that changes make some models better_
2024-06-27 20:20:30 -07:00
Islam Nofl
cc261580ac
Rename ollama prompt 'Function' word to 'Name'
2024-06-27 20:20:30 -07:00
corrm
a7efb9c332
Added improved function name handling in ollama_async_streaming
2024-06-27 20:20:30 -07:00
corrm
5d5227294d
chore: Improved OllamaConfig get_required_params and ollama_acompletion and ollama_async_streaming functions
2024-06-27 20:20:30 -07:00
corrm
e1e8f5a00e
chore: Improved prompt generation in ollama_pt function
2024-06-27 20:20:30 -07:00
Krrish Dholakia
bb64c68daf
docs(routing.md): add quickstart
2024-06-27 20:20:30 -07:00
Krrish Dholakia
673696222d
fix(langfuse.py): cleanup
2024-06-27 20:20:30 -07:00
Ishaan Jaff
4d7b2e578c
bump: version 1.40.25 → 1.40.26
2024-06-27 20:20:30 -07:00
Ishaan Jaff
c5020878e4
/spend/calculate use model aliases on this endpoint
2024-06-27 20:20:30 -07:00
Ishaan Jaff
08f83e6392
test - aliases on /spend/calculate
2024-06-27 20:20:30 -07:00
Krrish Dholakia
690c7f6e47
fix(router.py): log rejected router requests to langfuse
...
Fixes issue where rejected requests weren't being logged
2024-06-27 20:20:30 -07:00
Ishaan Jaff
7a961e8a0b
docs control available public routes
2024-06-27 20:20:30 -07:00
Ishaan Jaff
412c1fc541
fix importing litellm
2024-06-27 20:20:29 -07:00
Ishaan Jaff
e7ff5014b1
example cofnig with public routes
2024-06-27 20:20:29 -07:00
Ishaan Jaff
fa5eb5c96f
add helper to check route_in_additonal_public_routes
2024-06-27 20:20:29 -07:00
Ishaan Jaff
556ef8dd18
test - spend/calculate endpoints
2024-06-27 20:20:29 -07:00
Ishaan Jaff
2cb4d845ae
feat - refactor /spend/calculate
2024-06-27 20:20:29 -07:00
Ishaan Jaff
bfae8c3da6
example config with public routes
2024-06-27 20:20:29 -07:00
Ishaan Jaff
e30410f700
feat - allow user to define public routes
2024-06-27 20:20:29 -07:00
Krrish Dholakia
a087596be0
fix(vertex_httpx.py): Return empty model response for content filter violations
2024-06-27 20:20:29 -07:00
Krrish Dholakia
6f2f89d7b2
fix(vertex_httpx.py): cover gemini content violation (on prompt)
2024-06-27 20:20:29 -07:00
Krrish Dholakia
438f65666b
fix(utils.py): catch 422-status errors
2024-06-27 20:20:29 -07:00
Krrish Dholakia
82c6f31095
test(test_router.py): add testing
2024-06-27 20:20:29 -07:00
Krrish Dholakia
2e588c0685
fix(router.py): use user-defined model_input_tokens for pre-call filter checks
2024-06-27 20:20:29 -07:00
Krrish Dholakia
247d71db7a
fix(utils.py): fix exception_mapping check for errors
...
If exception already mapped - don't attach traceback to it
2024-06-27 20:20:29 -07:00
Ishaan Jaff
6ac0f20099
docs - update telemetry
2024-06-27 20:20:29 -07:00
Ishaan Jaff
b2302bf224
fix ui login bug
2024-06-27 20:20:29 -07:00
7HR4IZ3
4e84147593
fix: Lunary integration
...
Fixes the bug of litellm not logging system messages to lunary
2024-06-27 20:20:29 -07:00
Krrish Dholakia
af21695f2b
test: skip unstable tests
2024-06-27 20:20:29 -07:00
Krrish Dholakia
d2fe2b30a9
test(test_completion.py): handle replicate api error
2024-06-27 20:20:29 -07:00
Krrish Dholakia
b577f65798
test(test_proxy_server_langfuse.py): cleanup tests causing OOM issues.
2024-06-27 20:20:29 -07:00
Krrish Dholakia
c450dee681
fix(redact_messages.py): fix pr
2024-06-27 20:20:29 -07:00
Krrish Dholakia
3c92467ae8
fix(test_dynamic_rate_limit_handler.py): cleanup
2024-06-27 20:20:29 -07:00
Krrish Dholakia
2834a6395a
fix(redact_messages.py): fix get
2024-06-27 20:20:29 -07:00
Krrish Dholakia
0971219470
docs(team_budgets.md): cleanup docs
2024-06-27 20:20:29 -07:00
Krrish Dholakia
544338bdf4
bump: version 1.40.24 → 1.40.25
2024-06-27 20:20:29 -07:00
Marc Abramowitz
379b834480
Document feature
2024-06-27 20:20:29 -07:00
Marc Abramowitz
d14138dbd9
Rename request header
2024-06-27 20:20:29 -07:00
Marc Abramowitz
efae9fa991
Turn on message logging via request header
2024-06-27 20:20:29 -07:00
Krrish Dholakia
7f54c90459
fix(add-exception-mapping-+-langfuse-exception-logging-for-streaming-exceptions): add exception mapping + langfuse exception logging for streaming exceptions
...
Fixes https://github.com/BerriAI/litellm/issues/4338
2024-06-27 20:20:29 -07:00