Krish Dholakia
c0717133a9
Merge pull request #4909 from idris/fix-datadog-attributes
...
Fix Datadog logging attributes
2024-07-26 14:19:10 -07:00
Idris Mokhtarzada
e8d4234dbd
Better JSON serialization for Datadog logs
...
Dicts are now properly serialized to JSON so that Datadog can parse the child attributes. Also, numbers and nulls are sent as numbers and nulls instead of strings.
2024-07-26 17:02:05 -04:00
Idris Mokhtarzada
a7e877d15f
Use milliseconds for response_time in Datadog logs
...
milliseconds is more commonly used and more standard than seconds
2024-07-26 16:43:21 -04:00
Idris Mokhtarzada
9b89280a90
Use underscores
...
Datadog does not play nice with special characters (as in "(seconds)"). Also just makes sense to standardize on either underscores or camelCase, but not mix-and-match.
2024-07-26 16:38:54 -04:00
Krrish Dholakia
b515d4f441
docs(stream.md): add streaming token usage info to docs
...
Closes https://github.com/BerriAI/litellm/issues/4904
2024-07-26 10:51:17 -07:00
Krrish Dholakia
9a6ed8cabb
fix(bedrock_httpx.py): fix streaming error message
...
Fixes https://github.com/BerriAI/litellm/issues/4900
2024-07-26 10:42:47 -07:00
Krish Dholakia
67115a56c0
Merge pull request #4869 from maamalama/anthropic-tools
...
Fixed tool_call for Helicone integration
2024-07-26 10:42:10 -07:00
Krrish Dholakia
7ca29d987d
docs(docusaurus.config.js): add llm model cost map to docs
2024-07-26 10:07:47 -07:00
Krrish Dholakia
84482703b8
docs(config.md): update wildcard docs
2024-07-26 08:59:53 -07:00
Krrish Dholakia
1d6c39a607
feat(proxy_server.py): handle pydantic mockselvar error
...
Fixes https://github.com/BerriAI/litellm/issues/4898#issuecomment-2252105485
2024-07-26 08:38:51 -07:00
Krish Dholakia
35737d04d3
Merge pull request #4893 from yujonglee/canary
...
[Docs] Better search experience with Canary
2024-07-26 08:34:54 -07:00
yujonglee
10ffb5a960
remove ui shift on reload
2024-07-26 22:13:04 +09:00
yujonglee
8a45abb563
fix import and add fallback
2024-07-26 22:00:48 +09:00
yujonglee
c54f23f936
wrap existing search bar
2024-07-26 21:46:36 +09:00
yujonglee
3967007595
update to latest
2024-07-26 21:06:53 +09:00
Krrish Dholakia
afcad9e12c
docs(custom_llm_server.md): cleanup docs
2024-07-25 22:45:03 -07:00
Krrish Dholakia
ce210ddaf6
fix(vertex_ai_llama3.py): Fix llama3 streaming issue
...
Closes https://github.com/BerriAI/litellm/issues/4885
2024-07-25 22:30:55 -07:00
Krrish Dholakia
0ce5a7962e
bump: version 1.42.2 → 1.42.3
2024-07-25 22:18:17 -07:00
Krrish Dholakia
2f773d9cb6
fix(litellm_cost_calc/google.py): support meta llama vertex ai cost tracking
2024-07-25 22:12:07 -07:00
Ishaan Jaff
2626cc6d30
bump: version 1.42.1 → 1.42.2
2024-07-25 20:16:05 -07:00
Ishaan Jaff
24fb6fc28d
Merge pull request #4891 from BerriAI/litellm_proxy_support_all_providers
...
[Feat] Support /* for multiple providers
2024-07-25 20:15:42 -07:00
Ishaan Jaff
079a41fbe1
Merge branch 'main' into litellm_proxy_support_all_providers
2024-07-25 20:15:37 -07:00
Ishaan Jaff
4bf9681df4
Update README.md
2024-07-25 20:12:32 -07:00
Ishaan Jaff
4d513e0b5f
Merge pull request #4897 from BerriAI/docs_add_example_using_anthropic_sdk
...
Docs add example using anthropic sdk with litellm proxy
2024-07-25 20:11:16 -07:00
yujonglee
b6bcb7eb3c
update lock
2024-07-26 12:10:05 +09:00
Ishaan Jaff
50bf488b58
read me link to using litellm
2024-07-25 20:10:02 -07:00
Ishaan Jaff
9247fc3c64
deploy link to using litellm
2024-07-25 20:09:49 -07:00
yujonglee
a540c23730
improvements
2024-07-26 12:08:46 +09:00
Ishaan Jaff
c2e309baf3
docs using litellm proxy
2024-07-25 20:05:28 -07:00
Ishaan Jaff
87cebdefd3
Merge pull request #4896 from BerriAI/docs_add_example_usage_with_mistral_python
...
Docs Proxy - add example usage with mistral SDK with Proxy
2024-07-25 20:02:26 -07:00
Krrish Dholakia
826bb125e8
test(test_router.py): handle azure api instability
2024-07-25 19:54:40 -07:00
Ishaan Jaff
646b2d50f9
docs -quick start
2024-07-25 19:52:53 -07:00
Krrish Dholakia
a2fd8459fc
fix(utils.py): don't raise error on openai content filter during streaming - return as is
...
Fixes issue where we would raise an error vs. openai who return the chunk with finish reason as 'content_filter'
2024-07-25 19:50:52 -07:00
Ishaan Jaff
68e94f0976
example mistral sdk
2024-07-25 19:48:54 -07:00
Ishaan Jaff
bb6f72b315
add mistral sdk usage
2024-07-25 19:47:54 -07:00
Ishaan Jaff
5bec2bf513
Merge pull request #4894 from BerriAI/litellm_logfire_dotenv
...
fix logfire - don't load_dotenv
2024-07-25 19:34:35 -07:00
Ishaan Jaff
693bcfac39
fix using pass_through_all_models
2024-07-25 19:32:49 -07:00
Krish Dholakia
53752100f6
Merge pull request #4870 from BerriAI/litellm_redis_team_object
...
feat(auth_check.py): support using redis cache for team objects
2024-07-25 19:32:04 -07:00
Krish Dholakia
c2086300b7
Merge branch 'main' into litellm_redis_team_object
2024-07-25 19:31:52 -07:00
Krish Dholakia
80e2facf3d
Merge pull request #4883 from Manouchehri/bedrock-llama3.1-405b
...
Add Llama 3.1 405b & Tool Calling for Amazon Bedrock
2024-07-25 19:29:18 -07:00
Krish Dholakia
b6ca4406b6
Merge branch 'main' into bedrock-llama3.1-405b
2024-07-25 19:29:10 -07:00
Ishaan Jaff
a0655b4192
Merge pull request #4884 from Manouchehri/add-mistral-large-2407-bedrock-1
...
Add mistral.mistral-large-2407-v1:0 on Amazon Bedrock
2024-07-25 19:22:46 -07:00
Ishaan Jaff
fcd834b277
fix logfire - don't load_dotenv
2024-07-25 19:22:26 -07:00
Ishaan Jaff
af1cd9e06f
docs on pass through support
2024-07-25 19:17:20 -07:00
Krish Dholakia
c0c934d9cf
Merge pull request #4879 from fracapuano/main
...
Add Single-Token predictions support for Replicate
2024-07-25 19:10:57 -07:00
Krish Dholakia
a306b83b2d
Merge pull request #4887 from BerriAI/litellm_custom_llm
...
feat(custom_llm.py): Support Custom LLM Handlers
2024-07-25 19:05:29 -07:00
Krrish Dholakia
41abd51240
fix(custom_llm.py): pass input params to custom llm
2024-07-25 19:03:52 -07:00
Ishaan Jaff
ff0f21a1f3
docs - anthropic
2024-07-25 19:02:22 -07:00
Ishaan Jaff
26a9f694e1
Merge pull request #4890 from BerriAI/docs_set_routing_strategies
...
docs - add info about routing strategy on load balancing docs
2024-07-25 18:55:51 -07:00
Ishaan Jaff
05858cb249
test proxy all model
2024-07-25 18:54:30 -07:00