Commit graph

2919 commits

Author SHA1 Message Date
Krrish Dholakia
cb20554c79 fix(proxy_server.py): accept single quote json body 2023-11-02 07:07:38 -07:00
Krrish Dholakia
a12d0508c4 fix(proxy_server.py): fix v1/models get request 2023-11-02 06:51:47 -07:00
ishaan-jaff
7a389489b7 bump: version 0.12.8 → 0.12.9 2023-11-01 18:33:16 -07:00
ishaan-jaff
0a41443c3e (test) hf text_completion 2023-11-01 18:25:13 -07:00
ishaan-jaff
8b5ee89d82 (feat) add transform_logprobs for text_completion 2023-11-01 18:25:13 -07:00
ishaan-jaff
8ca7af3a63 (feat) text completion set top_n_tokens for tgi 2023-11-01 18:25:13 -07:00
ishaan-jaff
19737f95c5 (feat) proxy add testing for openai.Completion.create 2023-11-01 18:25:13 -07:00
ishaan-jaff
bc61c81cc6 (feat) proxy server add route ngines/{model:path}/completions 2023-11-01 18:25:13 -07:00
ishaan-jaff
700fcfa5fb (feat) text_completion add transform_logprobs 2023-11-01 18:25:13 -07:00
ishaan-jaff
1d0ce77baf (fix) improve litellm.set_verbose=True logging 2023-11-01 18:25:13 -07:00
Krrish Dholakia
73cd0f3778 docs(proxy_server.md): cleanup 2023-11-01 18:13:22 -07:00
Krrish Dholakia
82065716de docs(lm_evaluation_harness.md): adding github link to docs 2023-11-01 17:46:21 -07:00
Krrish Dholakia
9afd3c8bfa docs(lm_evaluation_harness.md): tutorial showing how to use lm evaluation harness with tgi 2023-11-01 17:45:16 -07:00
Krrish Dholakia
b305492a0b fix(huggingface_restapi.py): fix linting issue 2023-11-01 16:43:35 -07:00
Krrish Dholakia
aaa2a0dfb5 bump: version 0.12.7 → 0.12.8 2023-11-01 16:39:50 -07:00
Krrish Dholakia
2c4cb76ce5 fix(huggingface_restapi.py): fix embeddings for sentence-transformer models 2023-11-01 16:36:46 -07:00
Krrish Dholakia
ab0a29e160 fix(proxy_server.py): return all locally available ollama models 2023-11-01 16:20:26 -07:00
ishaan-jaff
d492bca05e (test) test_stream_chunk_builder 2023-11-01 14:54:00 -07:00
ishaan-jaff
863867fe00 (fix) stream_chunk_builder 2023-11-01 14:53:09 -07:00
ishaan-jaff
3fecab30d8 (test) amazon.titan-embed-text-v1 2023-11-01 14:46:46 -07:00
ishaan-jaff
9cfd218101 (feat) detect amazon.titan-embed-text-v1 as bedrock embedding model 2023-11-01 14:46:33 -07:00
ishaan-jaff
f4a45ec35b (docs) bedrock 2023-11-01 14:17:53 -07:00
ishaan-jaff
dc5a50d20e (docs) bedrock 2023-11-01 14:16:13 -07:00
ishaan-jaff
5c92cca9a4 (docs) add bedrock embedding 2023-11-01 14:15:08 -07:00
ishaan-jaff
59b3a64e64 (docs) add bedrock embeddings() 2023-11-01 14:12:48 -07:00
Krrish Dholakia
f9ff03d5af fix(utils.py): mapping stop sequences for palm 2023-11-01 14:00:45 -07:00
ishaan-jaff
a46d6a2dc9 (test) add bedrock/amazon.titan-embed-text-v1 2023-11-01 13:55:28 -07:00
ishaan-jaff
2ad81bdd7b (feat) embedding() add bedrock/amazon.titan-embed-text-v1 2023-11-01 13:55:28 -07:00
Krrish Dholakia
8deeb52f7c docs(function_call.md): cleanup 2023-11-01 13:55:00 -07:00
Krrish Dholakia
fb4be198ee docs(routing.md): adding context window fallback dict and num retries 2023-11-01 13:52:18 -07:00
ishaan-jaff
270fc02578 (docs) add litellm.api_version 2023-11-01 11:52:20 -07:00
ishaan-jaff
d72cd8576e (test) use litellm.api_version 2023-11-01 11:52:01 -07:00
ishaan-jaff
317c290b69 (test) add num retries to caching testing 2023-11-01 11:42:40 -07:00
ishaan-jaff
01d90691f9 (docs) add num_retries to docstring 2023-11-01 10:55:56 -07:00
ishaan-jaff
70885bdba6 (test) stream chunk builder 2023-11-01 08:38:19 -07:00
Krish Dholakia
d898b1c412
Merge pull request #734 from morgendigital/patch-1
Docker Hub image is built for ARM64 only
2023-11-01 08:21:45 -07:00
Ishaan Jaff
66850479cd
Merge pull request #741 from stanfea/main
Use supplied headers
2023-11-01 08:08:12 -07:00
stefan
bbc82f3afa Use supplied headers 2023-11-01 20:31:16 +07:00
ishaan-jaff
f6983223f9 (test) track usage in custom callback streaming 2023-10-31 23:05:42 -07:00
ishaan-jaff
d1f2593dc0 (fix) add usage tracking in callback 2023-10-31 23:02:54 -07:00
ishaan-jaff
522f1ac7c8 (docs) bedrock 2023-10-31 22:32:41 -07:00
Krrish Dholakia
7762ae7762 feat(utils.py): accept context window fallback dictionary 2023-10-31 22:32:36 -07:00
ishaan-jaff
2f6fed30ad (test) bedrock.cohere testing 2023-10-31 22:26:43 -07:00
ishaan-jaff
fa7e063198 (feat) add bedrock.cohere streaming 2023-10-31 22:26:43 -07:00
Krrish Dholakia
0ffb1dcc38 test(test_completion_with_retries.py): cleanup tests 2023-10-31 21:49:33 -07:00
Krrish Dholakia
f3efd566c9 style(main.py): fix linting issues 2023-10-31 19:23:14 -07:00
Krrish Dholakia
125642563c feat(completion()): adding num_retries
https://github.com/BerriAI/litellm/issues/728
2023-10-31 19:14:55 -07:00
ishaan-jaff
cedc756d2e (docs) hf viewing log probs 2023-10-31 18:37:18 -07:00
Krrish Dholakia
6ead8d8c18 fix(caching.py): fixing pr issues 2023-10-31 18:32:40 -07:00
ishaan-jaff
c0e6596395 (docs) hf 2023-10-31 18:25:44 -07:00