Commit graph

2095 commits

Author SHA1 Message Date
Ishaan Jaff
1abd66db1b fix langsmith logging for streaming 2024-07-17 16:04:45 -07:00
Ishaan Jaff
d3ee7a947c use langsmith as a custom callback class 2024-07-17 15:35:13 -07:00
Krrish Dholakia
830c21b1fd fix(utils.py): return optional params from groq 2024-07-17 12:09:08 -07:00
Krrish Dholakia
cbd011a2aa fix(utils.py): fix linting error 2024-07-16 20:57:34 -07:00
Krrish Dholakia
5651a66b88 fix(utils.py): fix get_api_base to use vertexai_anthropic 2024-07-16 19:17:45 -07:00
Ishaan Jaff
a0e0fba583 fix install on python 3.8 2024-07-16 17:00:32 -07:00
Ishaan Jaff
44410b4e07 fix installing on python3.8 2024-07-16 16:56:15 -07:00
Vinnie Giarrusso
27dbafc1ac refactor a bit 2024-07-16 12:19:31 -07:00
Krish Dholakia
b6ede4eb1b Merge pull request #4716 from pamelafox/countfuncs
Add token counting for OpenAI tools/tool_choice
2024-07-16 07:21:31 -07:00
Vinnie Giarrusso
0535bd2d68 Add enabled_roles to Guardrails configuration, Update Lakera guardrail moderation hook 2024-07-16 01:52:08 -07:00
Krrish Dholakia
ae96837a26 fix(utils.py): allow passing dynamic api base for openai-compatible endpoints 2024-07-15 20:00:44 -07:00
Krrish Dholakia
4687b12732 fix(litellm_logging.py): log response_cost=0 for failed calls
Fixes https://github.com/BerriAI/litellm/issues/4604
2024-07-15 19:25:56 -07:00
Krrish Dholakia
cdfe1e6847 fix(utils.py): update get_model_info docstring
Fixes https://github.com/BerriAI/litellm/issues/4711
2024-07-15 18:18:50 -07:00
Pamela Fox
b08e6e1b8a Docstring 2024-07-15 11:12:42 -07:00
Pamela Fox
3bd161ba63 Less changes 2024-07-15 11:11:21 -07:00
Pamela Fox
da8167699e Less changes 2024-07-15 11:09:45 -07:00
Pamela Fox
ae6b8450c1 Count tokens for tools 2024-07-15 11:07:52 -07:00
Krrish Dholakia
219dbf4f36 build(model_prices_and_context_window.json): add azure ai jamba instruct pricing + token details
Adds jamba instruct, mistral, llama3 pricing + token info for azure_ai
2024-07-13 16:34:31 -07:00
Ishaan Jaff
1d99eeb188 fix str from BadRequestError 2024-07-13 09:54:32 -07:00
Krrish Dholakia
d4ba87840e fix(proxy_server.py): fix linting errors 2024-07-11 22:12:33 -07:00
Ishaan Jaff
e3914c6e0f fix supports vision test 2024-07-11 21:14:25 -07:00
Krrish Dholakia
d85f24a80b fix(utils.py): fix recreating model response object when stream usage is true 2024-07-11 21:01:12 -07:00
Ishaan Jaff
bf50c8e087 Merge pull request #4661 from BerriAI/litellm_fix_mh
[Fix] Model Hub - Show supports vision correctly
2024-07-11 15:03:37 -07:00
Ishaan Jaff
a16cd02cd9 fix supports vision 2024-07-11 12:59:42 -07:00
Krrish Dholakia
57584ce879 feat(utils.py): accept 'api_key' as param for validate_environment
Closes https://github.com/BerriAI/litellm/issues/4375
2024-07-11 12:02:23 -07:00
Krrish Dholakia
af1064941a fix(types/utils.py): fix streaming function name 2024-07-10 21:56:47 -07:00
Yulong Liu
e2c0b88291 remove print 2024-07-08 17:03:07 -07:00
Yulong Liu
10212b3da8 Merge branch 'main' into empower-functions-v1 2024-07-08 17:01:15 -07:00
Krrish Dholakia
aecbc98b9b fix(proxy_cli.py): bump default azure api version 2024-07-08 16:28:22 -07:00
Krrish Dholakia
bc53cdd666 fix(utils.py): additional_drop_params support for embedding + image gen
Closes https://github.com/BerriAI/litellm/issues/4354
2024-07-08 15:25:47 -07:00
Krrish Dholakia
d68ab2a8bc fix(whisper---handle-openai/azure-vtt-response-format): Fixes https://github.com/BerriAI/litellm/issues/4595 2024-07-08 09:10:40 -07:00
Krrish Dholakia
a00a1267bc fix(utils.py): support 'drop_params' for 'parallel_tool_calls'
Closes https://github.com/BerriAI/litellm/issues/4584

 OpenAI-only param
2024-07-08 07:36:41 -07:00
Simon Sanchez Viloria
2057398bfb Added watsonx to stream wrapper __anext__ 2024-07-07 19:21:50 +02:00
Krrish Dholakia
d6149bcffb refactor(main.py): migrate vertex gemini calls to vertex_httpx
Completes migration to vertex_httpx
2024-07-06 20:08:52 -07:00
Krish Dholakia
c6b6dbeb6b Merge branch 'main' into litellm_fix_httpx_transport 2024-07-06 19:12:06 -07:00
Krish Dholakia
c643be0c0c Merge branch 'main' into litellm_gemini_stream_tool_calling 2024-07-06 19:07:31 -07:00
Krrish Dholakia
1dae0a5b6a fix(utils.py): cleanup 'additionalProperties=False' for tool calling with zod
Fixes issue with zod passing in additionalProperties=False, causing vertex ai / gemini calls to fail
2024-07-06 17:27:37 -07:00
Krrish Dholakia
9f900a1bed fix(vertex_httpx.py): support tool calling w/ streaming for vertex ai + gemini 2024-07-06 14:02:25 -07:00
Krrish Dholakia
7d7430d13a fix(utils.py): fix openrouter exception handling 2024-07-06 12:36:05 -07:00
Krish Dholakia
1ba61b908b Merge branch 'main' into litellm_tts_pricing 2024-07-06 11:02:59 -07:00
Krrish Dholakia
6220b70261 fix(cost_calculator.py): support openai+azure tts calls 2024-07-05 20:58:08 -07:00
Ishaan Jaff
3457fcc816 Merge pull request #4565 from BerriAI/litellm_fix_nvidia_nim_param_mapping
[Fix] Add nvidia nim param mapping based on `model`
2024-07-05 19:55:57 -07:00
Ishaan Jaff
75e8818b0d fix nvidia nim param mapping 2024-07-05 14:44:12 -07:00
Krrish Dholakia
deb7a86e9c fix(proxy/utils.py): support logging rejected requests to langfuse, etc. 2024-07-05 14:39:35 -07:00
Krrish Dholakia
1dab769ded fix(utils.py): fix openrouter supported params
Fixes https://github.com/BerriAI/litellm/issues/4508
2024-07-05 12:06:20 -07:00
Krish Dholakia
5cd4461273 Merge branch 'main' into feature/return-output-vector-size-in-modelinfo 2024-07-04 17:03:31 -07:00
Krrish Dholakia
4b2ac321b0 fix(utils.py): fix error string for exception raised 2024-07-04 15:52:46 -07:00
Krish Dholakia
2fa9a1f3cf Merge pull request #4461 from t968914/litellm-fix-vertexaibeta
fix: Include vertex_ai_beta in vertex_ai param mapping/Do not use google auth project_id
2024-07-04 15:27:20 -07:00
Krrish Dholakia
84044c08b6 fix(utils.py): stream_options working across all providers 2024-07-03 20:40:46 -07:00
Krrish Dholakia
150cfb68d5 fix(utils.py): stream_options fix 2024-07-03 19:57:34 -07:00