Commit graph

2884 commits

Author SHA1 Message Date
ishaan-jaff
3976cd27d7 (feat) add palm llms for model_prices json 2023-11-04 09:01:08 -07:00
ishaan-jaff
3e508ea257 (test) text_completion responses 2023-11-03 22:14:36 -07:00
ishaan-jaff
cc9f17a1a8 (feat) add TextCompletionResponse 2023-11-03 22:14:07 -07:00
ishaan-jaff
d4430fc51e (feat) text completion response now OpenAI Object 2023-11-03 22:13:52 -07:00
Krrish Dholakia
4c895d2e91 test(test_completion.py): cleanup 2023-11-03 18:31:41 -07:00
Krrish Dholakia
1c4dd0671b fix(bedrock.py): add exception mapping coverage for authentication scenarios 2023-11-03 18:25:34 -07:00
Krrish Dholakia
142750adff fix(bedrock.py): fix bedrock exception mapping 2023-11-03 18:14:12 -07:00
ishaan-jaff
53371d37b7 (docs) lm eval harness 2023-11-03 18:11:07 -07:00
ishaan-jaff
49650af444 (fix) bedrock: remove check for - if "error" in outputText 2023-11-03 18:06:23 -07:00
ishaan-jaff
34751d8562 (test) add text_completion with prompt list 2023-11-03 18:03:19 -07:00
ishaan-jaff
df57e9247a (fix) hf calculating usage non blocking 2023-11-03 18:03:19 -07:00
Krrish Dholakia
4e1885734a refactor(proxy_server.py): print statement showing how to add debug for logs 2023-11-03 17:41:14 -07:00
ishaan-jaff
6c4816e214 (fix) remove print statements 2023-11-03 16:45:28 -07:00
ishaan-jaff
f3dc06da04 (fix) temp_top_logprobs 2023-11-03 16:45:10 -07:00
ishaan-jaff
e29b2e8ce4 (fix) testing text_completion 2023-11-03 16:39:06 -07:00
ishaan-jaff
382e31d7b7 (test) text_completion requests 2023-11-03 16:36:38 -07:00
ishaan-jaff
b8d0a0fbd1 (test) cleanup remove text_completion testing from completion() 2023-11-03 16:36:38 -07:00
ishaan-jaff
0fa7c1ec3a (feat) text_com support batches for non openai llms 2023-11-03 16:36:38 -07:00
ishaan-jaff
b45d438e63 (fix) proxy server remove errant print 2023-11-03 16:36:38 -07:00
Krrish Dholakia
432520ffcf docs(simple_proxy.md): improving tutorial 2023-11-03 14:06:08 -07:00
Krrish Dholakia
22fd8953c1 docs(simple_proxy.md): adding docs 2023-11-03 14:03:48 -07:00
Krrish Dholakia
7ed8f8dac8 fix(proxy_server.py): fix linting issues 2023-11-03 13:44:35 -07:00
ishaan-jaff
b5751bd040 (cleanup) cookbook notebooks 2023-11-03 13:29:28 -07:00
ishaan-jaff
a8d65741f5 (cleanup) cookbooks 2023-11-03 13:25:10 -07:00
Ishaan Jaff
fe0699cc6c
Update README.md 2023-11-03 13:15:39 -07:00
Ishaan Jaff
9abfb45f0c
Update README.md 2023-11-03 13:12:09 -07:00
ishaan-jaff
af674701af (test) add palm streaming 2023-11-03 13:09:39 -07:00
Krrish Dholakia
9f180831fe docs(simple_proxy.md): doc cleanup 2023-11-03 13:07:07 -07:00
ishaan-jaff
6fc0c74878 (fix) remove errant print statements 2023-11-03 13:02:52 -07:00
ishaan-jaff
89e32db321 (fix) remove errant tg ai print statements 2023-11-03 12:59:23 -07:00
Krrish Dholakia
f6486b9df9 docs(simple_proxy.md): adding bedrock tutorial 2023-11-03 12:58:48 -07:00
ishaan-jaff
43e69a7aa8 (test) vertex ai 2023-11-03 12:54:36 -07:00
ishaan-jaff
6c82abf5bf (fix) vertex ai streaming 2023-11-03 12:54:36 -07:00
Krrish Dholakia
6b3671b593 fix(proxy_server.py): accept config.yaml 2023-11-03 12:50:52 -07:00
ishaan-jaff
e09b4cb01a bump: version 0.12.11 → 0.12.12 2023-11-03 10:04:14 -07:00
ishaan-jaff
539bdae364 (fix) remove errant print statements 2023-11-03 08:20:14 -07:00
ishaan-jaff
8b389e9e8a (fix) proxy correctly handle reading data using ast, fallback to json.loads if ast parse fails 2023-11-02 21:14:08 -07:00
ishaan-jaff
4d82c81531 (fix) proxy cli tests 2023-11-02 21:14:08 -07:00
ishaan-jaff
104239dbe7 (fix) proxy server - verbose = False always 2023-11-02 21:14:08 -07:00
Krrish Dholakia
e3a1c58dd9 build(litellm_server/utils.py): add support for general settings + num retries as a module variable 2023-11-02 20:56:41 -07:00
ishaan-jaff
3f1b4c0759 (fix) linting fix 2023-11-02 17:28:45 -07:00
ishaan-jaff
7c87d613ed (testing) test_function_call_non_openai_model 2023-11-02 17:26:30 -07:00
ishaan-jaff
e040df8989 bump: version 0.12.10 → 0.12.11 2023-11-02 17:15:38 -07:00
ishaan-jaff
bb832e38b9 (fix) litellm utils 2023-11-02 17:03:46 -07:00
ishaan-jaff
9d090db2d4 (test) vertex llms 2023-11-02 16:31:13 -07:00
ishaan-jaff
81f608dd34 (fix) vertexai detect code_chat and code_text llms as vertex 2023-11-02 16:31:13 -07:00
Krrish Dholakia
512a1637eb feat(completion()): enable setting prompt templates via completion() 2023-11-02 16:24:01 -07:00
ishaan-jaff
1fc726d5dd (fix) cleanup 2023-11-02 14:52:33 -07:00
ishaan-jaff
9484d19920 (docs) caching 2023-11-02 14:51:07 -07:00
ishaan-jaff
764ba41224 (docs) embedding 2023-11-02 10:57:57 -07:00