Ishaan Jaff
3df1186d72
Merge pull request #5402 from ajeetdsouza/patch-1
...
docs: add time.sleep() between streaming calls
2024-08-28 07:38:15 -07:00
Ajeet D'Souza
0533f77138
docs: add time.sleep() between streaming calls
...
LiteLLM's cache appears to be updated in the background. Without this `time.sleep()` call, both responses take `0.8s` to return, but after adding it, the second response returns in `0.006s`.
2024-08-28 17:59:07 +05:30
Ishaan Jaff
f1147696a3
ci/cd run again
2024-08-27 22:59:21 -07:00
Ishaan Jaff
c8fc5c44e1
ci/cd run again
2024-08-27 22:53:18 -07:00
Ishaan Jaff
5f025390bb
test test_image_generation_azure_dall_e_3
2024-08-27 22:52:11 -07:00
Ishaan Jaff
3966c545b4
fix flaky tests
2024-08-27 22:47:11 -07:00
Ishaan Jaff
bcf7f3e437
handle flaky pytests
2024-08-27 22:44:49 -07:00
Krrish Dholakia
640e5d0dc9
test: fix test
2024-08-27 22:44:29 -07:00
Ishaan Jaff
1ee0e8a9c3
undo chage on config.yaml
2024-08-27 22:24:21 -07:00
Ishaan Jaff
01987388c2
allow running contributor PRs
2024-08-27 22:17:01 -07:00
Ishaan Jaff
3d71e2228f
def test_get_bearer_token():
...
fix
2024-08-27 22:03:54 -07:00
Ishaan Jaff
f9c93c3adf
skip litellm.Timeout error
2024-08-27 21:32:27 -07:00
Ishaan Jaff
e396895288
update doc on palm provider
2024-08-27 21:11:24 -07:00
Ishaan Jaff
1b04380540
fix palm api is deactivated by google
2024-08-27 21:08:49 -07:00
Krrish Dholakia
f4fbe75af3
test: fix test
2024-08-27 19:33:14 -07:00
Ishaan Jaff
a420c5ba6e
fix test_completion_vllm
2024-08-27 18:40:39 -07:00
Ishaan Jaff
647504b462
add test for rerank on custom api base
2024-08-27 18:25:51 -07:00
Ishaan Jaff
be1bc99b60
Merge pull request #5395 from BerriAI/dependabot/npm_and_yarn/docs/my-website/webpack-5.94.0
...
build(deps): bump webpack from 5.93.0 to 5.94.0 in /docs/my-website
2024-08-27 18:16:36 -07:00
Ishaan Jaff
12693e94f1
docs add tg ai rerank docs
2024-08-27 18:14:40 -07:00
Ishaan Jaff
6ce5ba9694
add rerank on cohere docs
2024-08-27 18:11:42 -07:00
dependabot[bot]
491847b15e
build(deps): bump webpack from 5.93.0 to 5.94.0 in /docs/my-website
...
Bumps [webpack](https://github.com/webpack/webpack ) from 5.93.0 to 5.94.0.
- [Release notes](https://github.com/webpack/webpack/releases )
- [Commits](https://github.com/webpack/webpack/compare/v5.93.0...v5.94.0 )
---
updated-dependencies:
- dependency-name: webpack
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
2024-08-28 01:08:57 +00:00
Ishaan Jaff
218fb5fa34
bump: version 1.44.7 → 1.44.8
2024-08-27 18:07:22 -07:00
Ishaan Jaff
a5a17c120b
docs add rerank api to docs
2024-08-27 18:06:59 -07:00
Ishaan Jaff
afe62c4808
fix linting
2024-08-27 17:53:20 -07:00
Ishaan Jaff
ec7c9768c1
Merge pull request #5394 from BerriAI/litellm_add_rerank_on_proxy
...
feat - add rerank on litellm proxy / gateway
2024-08-27 17:52:12 -07:00
Ishaan Jaff
c27640e6e4
add /rerank test
2024-08-27 17:50:37 -07:00
Krrish Dholakia
834e204c73
test(test_exceptions.py): loosen test
2024-08-27 17:39:53 -07:00
Ishaan Jaff
5f2f7aa754
feat - add rerank on proxy
2024-08-27 17:36:40 -07:00
Ishaan Jaff
06529f19df
Merge pull request #5392 from BerriAI/litellm_add_native_cohere_rerank
...
[Feat] Add cohere rerank and together ai rerank
2024-08-27 17:29:37 -07:00
Ishaan Jaff
fb5be57bb8
v0 add rerank on litellm proxy
2024-08-27 17:28:39 -07:00
Ishaan Jaff
37ed201c50
fix install on 3.8
2024-08-27 17:09:16 -07:00
Krrish Dholakia
5b06ea136c
fix(openai.py): fix error re-raising
2024-08-27 17:06:25 -07:00
Ishaan Jaff
b3892b871d
add async support for rerank
2024-08-27 17:02:48 -07:00
Ishaan Jaff
f33dfe0b95
add rerank params
2024-08-27 16:45:39 -07:00
Ishaan Jaff
255ad865cd
add rerank api tests
2024-08-27 16:27:55 -07:00
Ishaan Jaff
dc42ad0021
add tg ai rerank support
2024-08-27 16:25:54 -07:00
Krrish Dholakia
bd3057e495
test(test_proxy_exception_mapping): loosen assert
2024-08-27 16:14:30 -07:00
Krrish Dholakia
6431af0678
fix(bedrock_httpx.py): support 'Auth' header as extra_header
...
Fixes https://github.com/BerriAI/litellm/issues/5389#issuecomment-2313677977
2024-08-27 16:08:54 -07:00
Ishaan Jaff
b8bc185bd5
add main cohere ai rerank handler + test
2024-08-27 15:57:36 -07:00
Ishaan Jaff
3a82334762
add basic cohere rerank
2024-08-27 15:55:43 -07:00
Krrish Dholakia
1b2f73c220
fix(azure_text.py): fix streaming parsing
2024-08-27 15:52:55 -07:00
Ishaan Jaff
6ab8cbc105
Merge pull request #5391 from BerriAI/litellm_add_ai21_support
...
[Feat] Add Vertex AI21 support
2024-08-27 15:06:26 -07:00
Krrish Dholakia
d2239e3c52
test(test_router_debug_logs.py): simplify test
2024-08-27 14:47:43 -07:00
Ishaan Jaff
33a3a01949
add mock test for ai21
2024-08-27 14:42:13 -07:00
Krrish Dholakia
deff357c92
fix(router.py): fix aembedding type hints
...
Fixes https://github.com/BerriAI/litellm/issues/5383
2024-08-27 14:29:18 -07:00
Krrish Dholakia
b91e5d3887
fix(openai.py): fix post call error logging for aembedding calls
2024-08-27 14:26:06 -07:00
Ishaan Jaff
3dee98dc47
add jamba-1.5
2024-08-27 14:20:06 -07:00
Krrish Dholakia
d2464052ec
docs(bedrock.md): add doc on passing extra headers + custom api endpoints to bedrock
...
Closes https://github.com/BerriAI/litellm/issues/5389
2024-08-27 14:18:41 -07:00
Ishaan Jaff
3c8a19e343
use cost per token for jamba
2024-08-27 14:18:04 -07:00
Ishaan Jaff
5bfacce548
add doc on using jamba-1.5-large
2024-08-27 14:12:38 -07:00