Commit graph

15234 commits

Author SHA1 Message Date
Krish Dholakia
c0717133a9
Merge pull request #4909 from idris/fix-datadog-attributes
Fix Datadog logging attributes
2024-07-26 14:19:10 -07:00
Idris Mokhtarzada
e8d4234dbd
Better JSON serialization for Datadog logs
Dicts are now properly serialized to JSON so that Datadog can parse the child attributes.  Also, numbers and nulls are sent as numbers and nulls instead of strings.
2024-07-26 17:02:05 -04:00
Idris Mokhtarzada
a7e877d15f
Use milliseconds for response_time in Datadog logs
milliseconds is more commonly used and more standard than seconds
2024-07-26 16:43:21 -04:00
Idris Mokhtarzada
9b89280a90
Use underscores
Datadog does not play nice with special characters (as in "(seconds)").  Also just makes sense to standardize on either underscores or camelCase, but not mix-and-match.
2024-07-26 16:38:54 -04:00
Krrish Dholakia
b515d4f441 docs(stream.md): add streaming token usage info to docs
Closes https://github.com/BerriAI/litellm/issues/4904
2024-07-26 10:51:17 -07:00
Krrish Dholakia
9a6ed8cabb fix(bedrock_httpx.py): fix streaming error message
Fixes https://github.com/BerriAI/litellm/issues/4900
2024-07-26 10:42:47 -07:00
Krish Dholakia
67115a56c0
Merge pull request #4869 from maamalama/anthropic-tools
Fixed tool_call for Helicone integration
2024-07-26 10:42:10 -07:00
Krrish Dholakia
7ca29d987d docs(docusaurus.config.js): add llm model cost map to docs 2024-07-26 10:07:47 -07:00
Krrish Dholakia
84482703b8 docs(config.md): update wildcard docs 2024-07-26 08:59:53 -07:00
Krrish Dholakia
1d6c39a607 feat(proxy_server.py): handle pydantic mockselvar error
Fixes https://github.com/BerriAI/litellm/issues/4898#issuecomment-2252105485
2024-07-26 08:38:51 -07:00
Krish Dholakia
35737d04d3
Merge pull request #4893 from yujonglee/canary
[Docs] Better search experience with Canary
2024-07-26 08:34:54 -07:00
yujonglee
10ffb5a960 remove ui shift on reload 2024-07-26 22:13:04 +09:00
yujonglee
8a45abb563 fix import and add fallback 2024-07-26 22:00:48 +09:00
yujonglee
c54f23f936 wrap existing search bar 2024-07-26 21:46:36 +09:00
yujonglee
3967007595 update to latest 2024-07-26 21:06:53 +09:00
Krrish Dholakia
afcad9e12c docs(custom_llm_server.md): cleanup docs 2024-07-25 22:45:03 -07:00
Krrish Dholakia
ce210ddaf6 fix(vertex_ai_llama3.py): Fix llama3 streaming issue
Closes https://github.com/BerriAI/litellm/issues/4885
2024-07-25 22:30:55 -07:00
Krrish Dholakia
0ce5a7962e bump: version 1.42.2 → 1.42.3 2024-07-25 22:18:17 -07:00
Krrish Dholakia
2f773d9cb6 fix(litellm_cost_calc/google.py): support meta llama vertex ai cost tracking 2024-07-25 22:12:07 -07:00
Ishaan Jaff
2626cc6d30 bump: version 1.42.1 → 1.42.2 2024-07-25 20:16:05 -07:00
Ishaan Jaff
24fb6fc28d
Merge pull request #4891 from BerriAI/litellm_proxy_support_all_providers
[Feat] Support /* for multiple providers
2024-07-25 20:15:42 -07:00
Ishaan Jaff
079a41fbe1
Merge branch 'main' into litellm_proxy_support_all_providers 2024-07-25 20:15:37 -07:00
Ishaan Jaff
4bf9681df4
Update README.md 2024-07-25 20:12:32 -07:00
Ishaan Jaff
4d513e0b5f
Merge pull request #4897 from BerriAI/docs_add_example_using_anthropic_sdk
Docs add example using anthropic sdk with litellm proxy
2024-07-25 20:11:16 -07:00
yujonglee
b6bcb7eb3c update lock 2024-07-26 12:10:05 +09:00
Ishaan Jaff
50bf488b58 read me link to using litellm 2024-07-25 20:10:02 -07:00
Ishaan Jaff
9247fc3c64 deploy link to using litellm 2024-07-25 20:09:49 -07:00
yujonglee
a540c23730 improvements 2024-07-26 12:08:46 +09:00
Ishaan Jaff
c2e309baf3 docs using litellm proxy 2024-07-25 20:05:28 -07:00
Ishaan Jaff
87cebdefd3
Merge pull request #4896 from BerriAI/docs_add_example_usage_with_mistral_python
Docs Proxy - add example usage with mistral SDK with Proxy
2024-07-25 20:02:26 -07:00
Krrish Dholakia
826bb125e8 test(test_router.py): handle azure api instability 2024-07-25 19:54:40 -07:00
Ishaan Jaff
646b2d50f9 docs -quick start 2024-07-25 19:52:53 -07:00
Krrish Dholakia
a2fd8459fc fix(utils.py): don't raise error on openai content filter during streaming - return as is
Fixes issue where we would raise an error vs. openai who return the chunk with finish reason as 'content_filter'
2024-07-25 19:50:52 -07:00
Ishaan Jaff
68e94f0976 example mistral sdk 2024-07-25 19:48:54 -07:00
Ishaan Jaff
bb6f72b315 add mistral sdk usage 2024-07-25 19:47:54 -07:00
Ishaan Jaff
5bec2bf513
Merge pull request #4894 from BerriAI/litellm_logfire_dotenv
fix logfire - don't load_dotenv
2024-07-25 19:34:35 -07:00
Ishaan Jaff
693bcfac39 fix using pass_through_all_models 2024-07-25 19:32:49 -07:00
Krish Dholakia
53752100f6
Merge pull request #4870 from BerriAI/litellm_redis_team_object
feat(auth_check.py): support using redis cache for team objects
2024-07-25 19:32:04 -07:00
Krish Dholakia
c2086300b7
Merge branch 'main' into litellm_redis_team_object 2024-07-25 19:31:52 -07:00
Krish Dholakia
80e2facf3d
Merge pull request #4883 from Manouchehri/bedrock-llama3.1-405b
Add Llama 3.1 405b & Tool Calling for Amazon Bedrock
2024-07-25 19:29:18 -07:00
Krish Dholakia
b6ca4406b6
Merge branch 'main' into bedrock-llama3.1-405b 2024-07-25 19:29:10 -07:00
Ishaan Jaff
a0655b4192
Merge pull request #4884 from Manouchehri/add-mistral-large-2407-bedrock-1
Add mistral.mistral-large-2407-v1:0 on Amazon Bedrock
2024-07-25 19:22:46 -07:00
Ishaan Jaff
fcd834b277 fix logfire - don't load_dotenv 2024-07-25 19:22:26 -07:00
Ishaan Jaff
af1cd9e06f docs on pass through support 2024-07-25 19:17:20 -07:00
Krish Dholakia
c0c934d9cf
Merge pull request #4879 from fracapuano/main
Add Single-Token predictions support for Replicate
2024-07-25 19:10:57 -07:00
Krish Dholakia
a306b83b2d
Merge pull request #4887 from BerriAI/litellm_custom_llm
feat(custom_llm.py): Support Custom LLM Handlers
2024-07-25 19:05:29 -07:00
Krrish Dholakia
41abd51240 fix(custom_llm.py): pass input params to custom llm 2024-07-25 19:03:52 -07:00
Ishaan Jaff
ff0f21a1f3 docs - anthropic 2024-07-25 19:02:22 -07:00
Ishaan Jaff
26a9f694e1
Merge pull request #4890 from BerriAI/docs_set_routing_strategies
docs - add info about routing strategy on load balancing docs
2024-07-25 18:55:51 -07:00
Ishaan Jaff
05858cb249 test proxy all model 2024-07-25 18:54:30 -07:00