Commit graph

3465 commits

Author SHA1 Message Date
Ishaan Jaff
7544d1925c
Update requirements.txt 2023-11-17 17:37:27 -08:00
ishaan-jaff
fd7f17b11b (chore) remove old dockerfile 2023-11-17 17:37:00 -08:00
ishaan-jaff
d1af0af7bf (docs) load balancer 2023-11-17 17:25:46 -08:00
ishaan-jaff
42432bedaa (docs) add example load balancer 2023-11-17 17:25:12 -08:00
Krrish Dholakia
7376e57e9c refactor(router.py): code cleanup 2023-11-17 17:05:46 -08:00
Krrish Dholakia
5cddab9e54 test(test_langfuse.py): handle timeouts 2023-11-17 17:05:46 -08:00
ishaan-jaff
d2bac07b48 (test) parallel tool calling 2023-11-17 17:03:24 -08:00
ishaan-jaff
fdbaceab8e (docs) input params 2023-11-17 16:07:25 -08:00
Krrish Dholakia
985583023a test(test_completion.py): change tgai model 2023-11-17 16:06:42 -08:00
ishaan-jaff
30a95a7823 (docs) input params 2023-11-17 16:06:12 -08:00
ishaan-jaff
65ae7127be (docs) optional fields - tools, tool_choice 2023-11-17 16:04:40 -08:00
Krrish Dholakia
a99efc544e fix(test_router.py): catch timeouts 2023-11-17 15:56:06 -08:00
ishaan-jaff
bb9e7c65e9 (test) parallel function calling 2023-11-17 15:51:27 -08:00
ishaan-jaff
88200432b0 (feat) support parallel function calling 2023-11-17 15:51:27 -08:00
ishaan-jaff
32f22adf8b (feat) openai improve logging post_call 2023-11-17 15:51:27 -08:00
ishaan-jaff
7de87c845b (feat) improve logging - show model_call_details 2023-11-17 15:51:27 -08:00
Krrish Dholakia
17bb1184bd fix(main.py): fix linting issue 2023-11-17 15:45:00 -08:00
Krrish Dholakia
0ab6b2451d fix(acompletion): support client side timeouts + raise exceptions correctly for async calls 2023-11-17 15:39:47 -08:00
Krish Dholakia
c4e53aa77b Updated config.yml 2023-11-17 14:24:04 -08:00
ishaan-jaff
f026ed4772 (test) test seed, response format, for gpt-3.5-turbo 2023-11-17 14:00:42 -08:00
ishaan-jaff
7abb65d53f (feat) completion: add response_format, seed, tools, tool_choice 2023-11-17 13:59:57 -08:00
ishaan-jaff
3c03e82f98 (docs) update migration guide 2023-11-17 10:48:21 -08:00
ishaan-jaff
aa2a9fff99 (docs) get_max_tokens returns int not dict now 2023-11-17 10:39:13 -08:00
ishaan-jaff
bd82559553 (v1.0+ breaking change) get_max_tokens -> return int 2023-11-17 10:38:50 -08:00
ishaan-jaff
c162f8b4b0 (docs) test proxy 2023-11-17 10:19:12 -08:00
ishaan-jaff
54b6a767f4 (docs) using proxy 2023-11-17 10:19:01 -08:00
ishaan-jaff
79e93ee7aa (docs) proxy - aws sagemaker jumpstart 2023-11-17 10:04:35 -08:00
Krish Dholakia
107edc631c
Update README.md 2023-11-17 09:39:06 -08:00
Krish Dholakia
85b987741f
Update README.md 2023-11-17 09:38:26 -08:00
Ishaan Jaff
1a09b93214
Merge pull request #832 from BerriAI/dependabot/npm_and_yarn/docs/my-website/sharp-0.32.6
build(deps): bump sharp from 0.32.5 to 0.32.6 in /docs/my-website
2023-11-17 09:05:34 -08:00
Krrish Dholakia
3d45d8a58c test: load test router 2023-11-17 08:23:44 -08:00
ishaan-jaff
c7aba49d83 (ci/cd) re run pipeline 2023-11-17 08:07:02 -08:00
Krrish Dholakia
a27c2961dc docs(migration.md): new base case exception - apiconnectionerror 2023-11-16 22:04:14 -08:00
Krrish Dholakia
9bd1f4ebd0 fix(utils.py): improve exception mapping for vertex ai 2023-11-16 22:02:26 -08:00
ishaan-jaff
3e2750ffb9 (ci/cd) re run pipeline 2023-11-16 21:55:10 -08:00
Krrish Dholakia
75ef1d7eb4 fix(router.py): check if async response is coroutine 2023-11-16 21:53:35 -08:00
Krrish Dholakia
7456c26940 docs(routing.md): update tutorial on deploying router 2023-11-16 21:46:43 -08:00
Ishaan Jaff
61705f3467
(ci/cd) run again 2023-11-16 21:29:18 -08:00
Krrish Dholakia
7ef1014e59 fix(factory.py): for ollama models check if it's instruct or not before applying prompt template 2023-11-16 15:45:08 -08:00
ishaan-jaff
25b2bc6da9 (test) add --debug to cli tool 2023-11-16 14:46:26 -08:00
Krrish Dholakia
51bf637656 feat: global client for sync + async calls (openai + Azure only) 2023-11-16 14:44:13 -08:00
ishaan-jaff
5fd4376802 (docs) lm harness 2023-11-16 14:30:33 -08:00
ishaan-jaff
8d0f4bfc74 (docs) lm harness 2023-11-16 14:21:37 -08:00
Krrish Dholakia
d7f7694848 fix(openai.py): fix linting issues 2023-11-16 12:57:53 -08:00
Krrish Dholakia
a94c09c13c fix(openai.py): handling extra headers 2023-11-16 12:48:21 -08:00
ishaan-jaff
9e072f87bd (fix) bedrock meta llama optional params 2023-11-16 12:38:27 -08:00
ishaan-jaff
23d560071b (linting) fix 2023-11-16 12:33:03 -08:00
ishaan-jaff
f8af5e0155 (fix) linting 2023-11-16 12:25:46 -08:00
ishaan-jaff
2dc411fdb3 (test) hf streaming 2023-11-16 12:24:31 -08:00
ishaan-jaff
04971674b4 (fix) only decode chunk when it's not a str 2023-11-16 12:24:31 -08:00