Ishaan Jaff
97ecf86d3d
fix langsmith load tests
2024-09-11 21:19:03 -07:00
Ishaan Jaff
b01a42ef4f
fix langsmith load test
2024-09-11 21:16:16 -07:00
Ishaan Jaff
a1f8fcfeed
fix load test
2024-09-11 21:06:42 -07:00
Ishaan Jaff
da29b070bb
print load test results
2024-09-11 20:53:52 -07:00
Ishaan Jaff
a08ad0ea70
add load tests to ci/cd
2024-09-11 20:50:57 -07:00
Ishaan Jaff
850b5dbadc
add otel load test
2024-09-11 20:47:12 -07:00
Ishaan Jaff
e7b047223e
add langsmith logging test
2024-09-11 20:35:11 -07:00
Ishaan Jaff
129113143e
Merge pull request #5642 from BerriAI/litellm_otel_fixes
...
[Fix-Perf] OTEL use sensible default values for logging
2024-09-11 18:06:34 -07:00
Ishaan Jaff
5dac4abd16
Merge branch 'main' into litellm_otel_fixes
2024-09-11 18:06:29 -07:00
Ishaan Jaff
f55318de47
Merge pull request #5638 from BerriAI/litellm_langsmith_perf
...
[Langsmith Perf Improvement] Use /batch for Langsmith Logging
2024-09-11 17:43:26 -07:00
Ishaan Jaff
368a5fd052
fix move logic to custom_batch_logger
2024-09-11 16:19:24 -07:00
steffen-sbt
de9a39e7c6
Add the option to specify a schema in the postgres DB, also modify docs ( #5640 )
2024-09-11 14:53:52 -07:00
Ishaan Jaff
e681619381
use vars for batch size and flush interval seconds
2024-09-11 14:40:58 -07:00
Ishaan Jaff
3376f151c6
fix otel use sensible defaults
2024-09-11 14:24:04 -07:00
Ishaan Jaff
0070741529
fix vtx test
2024-09-11 14:17:03 -07:00
Ishaan Jaff
d84fa05161
fix langsmith tenacity
2024-09-11 13:48:44 -07:00
Ishaan Jaff
f339f9614a
fix requirements.txt
2024-09-11 13:35:37 -07:00
Ishaan Jaff
1415bdd6fa
fix testing + req.txt
2024-09-11 13:30:42 -07:00
Ishaan Jaff
ede33230f2
use lock to flush events to langsmith
2024-09-11 13:27:16 -07:00
Ishaan Jaff
7cd7675458
add better debugging for flush interval
2024-09-11 13:02:34 -07:00
Ishaan Jaff
a66f03f860
fix installing litellm
2024-09-11 12:45:39 -07:00
Ishaan Jaff
0a6a437e64
use tenacity for langsmith
2024-09-11 12:41:22 -07:00
Ishaan Jaff
15277aff1c
fix langsmith clear logged queue on success
2024-09-11 11:56:24 -07:00
Krish Dholakia
0295a22561
LiteLLM Minor Fixes and Improvements (09/10/2024) ( #5618 )
...
* fix(cost_calculator.py): move to debug for noisy warning message on cost calculation error
Fixes https://github.com/BerriAI/litellm/issues/5610
* fix(databricks/cost_calculator.py): Handles model name issues for databricks models
* fix(main.py): fix stream chunk builder for multiple tool calls
Fixes https://github.com/BerriAI/litellm/issues/5591
* fix: correctly set user_alias when passed in
Fixes https://github.com/BerriAI/litellm/issues/5612
* fix(types/utils.py): allow passing role for message object
https://github.com/BerriAI/litellm/issues/5621
* fix(litellm_logging.py): Fix langfuse logging across multiple projects
Fixes issue where langfuse logger was re-using the old logging object
* feat(proxy/_types.py): support adding key-based tags for tag-based routing
Enable tag based routing at key-level
* fix(proxy/_types.py): fix inheritance
* test(test_key_generate_prisma.py): fix test
* test: fix test
* fix(litellm_logging.py): return used callback object
2024-09-11 11:30:29 -07:00
Christopher Chou
a451cfc2d6
Add gemini 1.5 flash exp 0827 ( #5636 )
2024-09-11 11:30:13 -07:00
Ishaan Jaff
860516c843
langsmith use batching for logging
2024-09-11 11:28:27 -07:00
Ishaan Jaff
2f670a16fc
fix langsmith_batch_size
2024-09-11 11:25:33 -07:00
Ishaan Jaff
ccda616f2f
Merge pull request #5631 from miri-bar/update_ai21_docs
...
docs: update ai21 docs
2024-09-11 09:27:35 -07:00
Ishaan Jaff
2fa9709af0
stash - langsmith use batching for logging
2024-09-11 08:06:56 -07:00
Miri Bar
ebf42d6764
docs: update ai21 docs
2024-09-11 13:35:40 +03:00
Ishaan Jaff
ce5182710f
ci/cd run again
2024-09-10 19:21:13 -07:00
Ishaan Jaff
720c7c6d08
Merge pull request #5629 from BerriAI/dependabot/npm_and_yarn/docs/my-website/multi-27a054522e
...
Bump body-parser and express in /docs/my-website
2024-09-10 19:12:57 -07:00
Ishaan Jaff
af960b2138
Merge pull request #5628 from BerriAI/dependabot/npm_and_yarn/docs/my-website/multi-e639cebc61
...
Bump serve-static and express in /docs/my-website
2024-09-10 19:12:45 -07:00
Ishaan Jaff
256c72d93b
Merge pull request #5626 from BerriAI/dependabot/npm_and_yarn/docs/my-website/multi-d983993043
...
Bump send and express in /docs/my-website
2024-09-10 19:12:36 -07:00
dependabot[bot]
35a81e7b23
Bump body-parser and express in /docs/my-website
...
Bumps [body-parser](https://github.com/expressjs/body-parser ) and [express](https://github.com/expressjs/express ). These dependencies needed to be updated together.
Updates `body-parser` from 1.20.2 to 1.20.3
- [Release notes](https://github.com/expressjs/body-parser/releases )
- [Changelog](https://github.com/expressjs/body-parser/blob/master/HISTORY.md )
- [Commits](https://github.com/expressjs/body-parser/compare/1.20.2...1.20.3 )
Updates `express` from 4.19.2 to 4.20.0
- [Release notes](https://github.com/expressjs/express/releases )
- [Changelog](https://github.com/expressjs/express/blob/master/History.md )
- [Commits](https://github.com/expressjs/express/compare/4.19.2...4.20.0 )
---
updated-dependencies:
- dependency-name: body-parser
dependency-type: indirect
- dependency-name: express
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
2024-09-11 02:11:53 +00:00
dependabot[bot]
1b41badb69
Bump serve-static and express in /docs/my-website
...
Bumps [serve-static](https://github.com/expressjs/serve-static ) and [express](https://github.com/expressjs/express ). These dependencies needed to be updated together.
Updates `serve-static` from 1.15.0 to 1.16.0
- [Release notes](https://github.com/expressjs/serve-static/releases )
- [Changelog](https://github.com/expressjs/serve-static/blob/master/HISTORY.md )
- [Commits](https://github.com/expressjs/serve-static/compare/v1.15.0...1.16.0 )
Updates `express` from 4.19.2 to 4.20.0
- [Release notes](https://github.com/expressjs/express/releases )
- [Changelog](https://github.com/expressjs/express/blob/master/History.md )
- [Commits](https://github.com/expressjs/express/compare/4.19.2...4.20.0 )
---
updated-dependencies:
- dependency-name: serve-static
dependency-type: indirect
- dependency-name: express
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
2024-09-11 02:11:51 +00:00
dependabot[bot]
e48459389c
Bump send and express in /docs/my-website
...
Bumps [send](https://github.com/pillarjs/send ) and [express](https://github.com/expressjs/express ). These dependencies needed to be updated together.
Updates `send` from 0.18.0 to 0.19.0
- [Release notes](https://github.com/pillarjs/send/releases )
- [Changelog](https://github.com/pillarjs/send/blob/master/HISTORY.md )
- [Commits](https://github.com/pillarjs/send/compare/0.18.0...0.19.0 )
Updates `express` from 4.19.2 to 4.20.0
- [Release notes](https://github.com/expressjs/express/releases )
- [Changelog](https://github.com/expressjs/express/blob/master/History.md )
- [Commits](https://github.com/expressjs/express/compare/4.19.2...4.20.0 )
---
updated-dependencies:
- dependency-name: send
dependency-type: indirect
- dependency-name: express
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
2024-09-11 02:11:46 +00:00
Ishaan Jaff
a6f9020884
bump: version 1.44.23 → 1.44.24
2024-09-10 19:10:27 -07:00
Ishaan Jaff
c1262addbe
Merge pull request #5623 from BerriAI/litellm_vertex_use_async_for_getting_token
...
[Feat-Vertex Perf] Use async func to get auth credentials
2024-09-10 18:53:48 -07:00
Ishaan Jaff
9261599ab9
add doc string to vertex llm base
2024-09-10 18:52:43 -07:00
Ishaan Jaff
8d773e66af
fix gemini streaming test
2024-09-10 17:50:24 -07:00
Ishaan Jaff
26aa20df73
fix test get token url
2024-09-10 17:38:03 -07:00
Ishaan Jaff
899eaa9566
Merge pull request #5571 from jalammar/cohere-updated-models
...
Add Cohere refresh models and update pricing
2024-09-10 17:22:51 -07:00
Ishaan Jaff
24474789d7
fix gemini test
2024-09-10 17:20:01 -07:00
Ishaan Jaff
96fa9d46f5
fix case when gemini is used
2024-09-10 17:06:45 -07:00
Ishaan Jaff
1c6f8b1be2
fix vertex use async func to set auth creds
2024-09-10 16:12:18 -07:00
Ishaan Jaff
aed48e3bad
Merge pull request #5622 from BerriAI/litellm_fix_auth_refresh_vertex
...
[Feat-Perf Improvement Vertex] Only Refresh credentials when token is expired
2024-09-10 15:03:35 -07:00
Ishaan Jaff
2d4be4cf1f
Merge pull request #5620 from BerriAI/litellm_use_helper_to_get_httpx_clients
...
[Feat-Perf] Use common helper to get async httpx clients for all providers
2024-09-10 15:03:11 -07:00
Ishaan Jaff
3ebff903c3
Merge branch 'main' into litellm_use_helper_to_get_httpx_clients
2024-09-10 15:02:54 -07:00
Ishaan Jaff
478a36ae36
fix bedrock get async client
2024-09-10 14:17:18 -07:00
