Commit graph

2919 commits

Author SHA1 Message Date
ishaan-jaff
4a32272bfd (docs) add doc string for check_valid_api_key 2023-10-30 14:02:31 -07:00
Krish Dholakia
545c34e862
Merge pull request #727 from chinmay7016/patch-1
Update README.md
2023-10-30 14:00:35 -07:00
ishaan-jaff
43b8387334 (docs) add doc string for aembedding 2023-10-30 13:59:56 -07:00
ishaan-jaff
370b6be52a (docs) update model alias 2023-10-30 13:58:07 -07:00
ishaan-jaff
689c14525c (docs) update token trimming 2023-10-30 13:56:23 -07:00
chinmay7016
41f15045fb
Update README.md
fixed the error
2023-10-31 02:24:37 +05:30
ishaan-jaff
7037913f9d (fix) update acompletion docstring 2023-10-30 13:53:32 -07:00
ishaan-jaff
359f40d483 (docs) getting started 2023-10-30 13:39:50 -07:00
Ishaan Jaff
f80ce3640c
Merge pull request #724 from dedeswim/patch-1
Update Together AI pricing
2023-10-30 09:13:23 -07:00
Edoardo Debenedetti
78ea8e6c41
Update Together AI pricing
Updated pricing for 20.1-40b and 40.1-70b models (source https://together.ai/pricing as of Oct 30)
2023-10-30 16:45:26 +01:00
seva
f4d65cf23d Add tests for cache with TTL 2023-10-30 13:35:55 +01:00
seva
5e1e8820b4 Router & Caching fixes:
- Add optional TTL to Cache parameters
- Fix tpm and rpm caching in Router
2023-10-30 13:29:35 +01:00
Krrish Dholakia
ee2e186c62 docs(routing.md): clean up title 2023-10-29 21:13:45 -07:00
Krish Dholakia
6e454a6ce9
Merge pull request #706 from mc-marcocheng/router/fix_dict
Fix Router.set_model_list & Avoid overwriting litellm_params
2023-10-29 21:11:26 -07:00
canada4663
bfa297e82f add ability to use custom AWS Bedrock Runtime endpoint via environment or .env variable AWS_BEDROCK_RUNTIME_ENDPOINT or as a parameter to init_bedrock_client 2023-10-28 22:25:45 -07:00
canada4663
1add0d604e add in ability to read AWS boto3 default AWS Region name if litellm .env config AWS_REGION_NAME not available 2023-10-28 21:43:48 -07:00
Krrish Dholakia
7304c75f9c docs(simple_proxy.md): updating copy 2023-10-28 19:21:19 -07:00
Krish Dholakia
a445074e0a
Update README.md 2023-10-28 19:20:27 -07:00
Krrish Dholakia
ffd80ca850 docs(input.md): updating litellm-specific params for completion 2023-10-28 19:17:07 -07:00
Krrish Dholakia
585f7b0434 docs(input.md): add litellm params to docs 2023-10-28 19:13:55 -07:00
Krrish Dholakia
758b75cb8d docs(simple_proxy.md): updating titles 2023-10-28 16:18:56 -07:00
Krrish Dholakia
23f03f7e6f docs(simple_proxy.md): add llama index tutorial to docs 2023-10-28 16:14:51 -07:00
Krish Dholakia
8a599e8053
Update README.md 2023-10-28 15:41:27 -07:00
ishaan-jaff
b76304246e (docs) reliability with fallbacks + router 2023-10-28 15:28:03 -07:00
Krrish Dholakia
b18b9d6380 docs(simple_proxy.md): add arize ai llm evals to docs 2023-10-28 15:14:27 -07:00
ishaan-jaff
8a8d3f686c (tests) easily track cost for responses 2023-10-28 15:08:35 -07:00
ishaan-jaff
d2ff7a17df (feat) track cost for responses easily 2023-10-28 15:08:35 -07:00
Krrish Dholakia
59e47fac78 docs(simple_proxy.md): prompt tools tutorials 2023-10-28 14:52:17 -07:00
Krrish Dholakia
7cd0aadf25 build(litellm_server/main.py): azure bug fixes 2023-10-28 14:12:51 -07:00
Krrish Dholakia
3e66fb2a83 build(litellm_server/main.py): updates 2023-10-28 14:09:57 -07:00
Krrish Dholakia
e3556494b3 build(litellm_server/main.py): support azure api key header 2023-10-28 14:02:05 -07:00
Krrish Dholakia
c9956e95c6 refactor(litellm_server/main.py): adding logging 2023-10-28 13:54:12 -07:00
Krrish Dholakia
b061d61130 build(litellm_server/main.py): build fixes 2023-10-28 13:52:05 -07:00
Krrish Dholakia
f01f181aaa build(litellm_server/main.py): loading env variables in utils 2023-10-28 13:47:46 -07:00
Krrish Dholakia
c0f66368f2 refactor(litellm_server/main.py): putting quotes on true as it's a env variable 2023-10-28 13:45:14 -07:00
Krrish Dholakia
80c9c58f88 build(litellm_server/main.py): adding print_verbose for better logging 2023-10-28 13:43:51 -07:00
Krrish Dholakia
6fdca38442 build(litellm_server/main.py): accomodate forward slash in azure url 2023-10-28 13:32:31 -07:00
Krrish Dholakia
9eb53acd8e build(litellm_server/main.py): make /chat/completions azure compatible 2023-10-28 13:25:22 -07:00
Krrish Dholakia
438b285451 build(litellm_server/main.py): add support for proxying azure endpoint 2023-10-28 13:18:43 -07:00
Ishaan Jaff
914067227a
Merge pull request #713 from josearangos/main
refactor Contributing to documentation steps
2023-10-28 12:39:40 -07:00
ishaan-jaff
2272a5d1fa (docs) cleanup remove bload - ab test lllms 2023-10-28 12:34:40 -07:00
Ishaan Jaff
86022f8e67
Update README.md 2023-10-28 12:29:44 -07:00
Ishaan Jaff
489d45cdfd
Update README.md 2023-10-28 12:25:58 -07:00
josearangos
cc7b06f8e4 refactor Contributing to documentation steps 2023-10-28 14:25:01 -05:00
Krrish Dholakia
347a5c46e2 docs(simple_proxy.md): adding NeMO Guardrails tutorial to docs 2023-10-28 12:17:16 -07:00
Krrish Dholakia
b178596d05 test(test_streaming.py): commenting out sagemaker test due to aws key issue 2023-10-28 12:10:07 -07:00
Krish Dholakia
82b190f94d
Update README.md 2023-10-28 11:47:50 -07:00
Krish Dholakia
e7ff90fc39
Update README.md 2023-10-28 11:46:53 -07:00
ishaan-jaff
d5e6777973 (fix) remove bloat completion_with_split_tests 2023-10-27 18:13:30 -07:00
ishaan-jaff
224a0b9367 (fix) remove bloat - rate limit manager 2023-10-27 18:11:54 -07:00