phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity
18392 commits 1603 branches 645 tags 320 MiB
Commit graph

48 commits

Author SHA1 Message Date
Krish Dholakia
d46660ea0f
LiteLLM Minor Fixes & Improvements (09/18/2024) (#5772) 
* fix(proxy_server.py): fix azure key vault logic to not require client id/secret

* feat(cost_calculator.py): support fireworks ai cost tracking

* build(docker-compose.yml): add lines for mounting config.yaml to docker compose

Closes https://github.com/BerriAI/litellm/issues/5739

* fix(input.md): update docs to clarify litellm supports content as a list of dictionaries

Fixes https://github.com/BerriAI/litellm/issues/5755

* fix(input.md): update input.md to include all message values

* fix(image_handling.py): follow image url redirects

Fixes https://github.com/BerriAI/litellm/issues/5763

* fix(router.py): Fix model key/base leak in error message

Fixes https://github.com/BerriAI/litellm/issues/5762

* fix(http_handler.py): fix linting error

* fix(azure.py): fix logging to show azure_ad_token being used

Fixes https://github.com/BerriAI/litellm/issues/5767

* fix(_redis.py): add redis sentinel support

Closes https://github.com/BerriAI/litellm/issues/4381

* feat(_redis.py): add redis sentinel support

Closes https://github.com/BerriAI/litellm/issues/4381

* test(test_completion_cost.py): fix test

* Databricks Integration: Integrate Databricks SDK as optional mechanism for fetching API base and token, if unspecified (#5746)

* LiteLLM Minor Fixes & Improvements (09/16/2024)  (#5723)

* coverage (#5713)

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Move (#5714)

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* fix(litellm_logging.py): fix logging client re-init (#5710)

Fixes https://github.com/BerriAI/litellm/issues/5695

* fix(presidio.py): Fix logging_hook response and add support for additional presidio variables in guardrails config

Fixes https://github.com/BerriAI/litellm/issues/5682

* feat(o1_handler.py): fake streaming for openai o1 models

Fixes https://github.com/BerriAI/litellm/issues/5694

* docs: deprecated traceloop integration in favor of native otel (#5249)

* fix: fix linting errors

* fix: fix linting errors

* fix(main.py): fix o1 import

---------

Signed-off-by: dbczumar <corey.zumar@databricks.com>
Co-authored-by: Corey Zumar <39497902+dbczumar@users.noreply.github.com>
Co-authored-by: Nir Gazit <nirga@users.noreply.github.com>

* feat(spend_management_endpoints.py): expose `/global/spend/refresh` endpoint for updating material view (#5730)

* feat(spend_management_endpoints.py): expose `/global/spend/refresh` endpoint for updating material view

Supports having `MonthlyGlobalSpend` view be a material view, and exposes an endpoint to refresh it

* fix(custom_logger.py): reset calltype

* fix: fix linting errors

* fix: fix linting error

* fix

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* fix: fix import

* Fix

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* fix

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* DB test

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* Coverage

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* progress

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* fix

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* fix

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* fix

Signed-off-by: dbczumar <corey.zumar@databricks.com>

* fix test name

Signed-off-by: dbczumar <corey.zumar@databricks.com>

---------

Signed-off-by: dbczumar <corey.zumar@databricks.com>
Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com>
Co-authored-by: Nir Gazit <nirga@users.noreply.github.com>

* test: fix test

* test(test_databricks.py): fix test

* fix(databricks/chat.py): handle custom endpoint (e.g. sagemaker)

* Apply code scanning fix for clear-text logging of sensitive information

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>

* fix(__init__.py): fix known fireworks ai models

---------

Signed-off-by: dbczumar <corey.zumar@databricks.com>
Co-authored-by: Corey Zumar <39497902+dbczumar@users.noreply.github.com>
Co-authored-by: Nir Gazit <nirga@users.noreply.github.com>
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
 2024-09-19 13:25:29 -07:00
Ishaan Jaff
c220fc0e92 docs max_completion_tokens 2024-09-14 19:12:12 -07:00
Krrish Dholakia
0c26b36d9d docs(input.md): update docs on together ai response_format params support 2024-08-23 21:34:18 -07:00
Krrish Dholakia
696e75d69c docs: add github provider to docs 2024-08-03 09:20:23 -07:00
Krrish Dholakia
f1b7d2318c docs(input.md): update docs to show ollama tool calling 2024-07-30 09:56:24 -07:00
Krrish Dholakia
ba334ff8b9 refactor(provider_specific_params.md): create separate doc for provider-specific param 
Make it easier for people to know, how litellm handles provider-specific params.
 2024-07-09 12:23:46 -07:00
Krrish Dholakia
be8a6377f6 docs(input.md): add vertex ai json mode to mapped input params 2024-06-29 11:51:52 -07:00
Krrish Dholakia
e96326a211 docs(input.md): update docs with parallel_tool_calls 2024-06-20 21:01:49 -07:00
Krrish Dholakia
f86dcbb109 docs(input.md): clarify meaning of 'drop_params' 2024-06-19 10:04:58 -07:00
Ishaan Jaff
69a20c94fd docs - fix doc build time errors 2024-06-15 14:58:02 -07:00
Krrish Dholakia
162f9400d2 feat(utils.py): support dynamically setting 'drop_params' 
Allows user to turn this on/off for individual calls by passing in as a completion arg
 2024-06-05 08:44:04 -07:00
Krrish Dholakia
9698fc77fd docs(input.md): add clarifai supported input params to docs 2024-05-24 08:57:50 -07:00
Krrish Dholakia
65c4d6be39 docs(databricks.md): add databricks api support to docs 2024-05-23 19:22:09 -07:00
Krrish Dholakia
af1d209f8f docs(input.md): add anthropic tool choice support to docs 2024-05-21 17:56:21 -07:00
Krrish Dholakia
7fa203c810 docs(input.md): add mistral to input param docs 2024-05-13 13:50:49 -07:00
Ishaan Jaff
e7e54772ae docs include stream_options param 2024-05-08 21:57:25 -07:00
Ishaan Jaff
d968dedd77
Merge pull request #1530 from TanaroSch/main 
change max_tokens type to int
 2024-05-04 12:47:15 -07:00
Krrish Dholakia
d8a6b8216d docs(input.md): add docs on 'get_supported_openai_params' 2024-03-08 23:54:13 -08:00
ishaan-jaff
c9567c8652 (docs) passing extra_headers to OpenAI 2024-02-23 09:27:48 -08:00
TanaroSch
b69cb2c773 change max_tokens float to int 2024-02-06 11:19:28 +01:00
ishaan-jaff
112ffa3596 (docs) add logprobs, top_logprobs 2023-12-26 14:53:30 +05:30
ishaan-jaff
f3844b309f (docs) input params - add logprobs, top_logprobs 2023-12-26 14:41:33 +05:30
ishaan-jaff
b2e69cbc24 (docs) input params 2023-12-26 14:36:19 +05:30
Krrish Dholakia
ff949490de docs(input.md): add hf_model_name to docs 2023-12-05 16:56:18 -08:00
ishaan-jaff
bbdfd143b8 (docs) input 2023-12-04 15:47:27 -08:00
ishaan-jaff
74d520b1b5 (docs) sagemaker - clarify max tokens 2023-12-04 15:15:39 -08:00
ishaan-jaff
20b129b7ad (docs) update timeout variable name 2023-11-21 13:14:55 -08:00
ishaan-jaff
fdbaceab8e (docs) input params 2023-11-17 16:07:25 -08:00
ishaan-jaff
30a95a7823 (docs) input params 2023-11-17 16:06:12 -08:00
ishaan-jaff
65ae7127be (docs) optional fields - tools, tool_choice 2023-11-17 16:04:40 -08:00
Krrish Dholakia
84460b8222 docs(input.md): adding anyscale supported params 2023-11-10 09:26:57 -08:00
Krrish Dholakia
fb4be198ee docs(routing.md): adding context window fallback dict and num retries 2023-11-01 13:52:18 -07:00
Krrish Dholakia
ffd80ca850 docs(input.md): updating litellm-specific params for completion 2023-10-28 19:17:07 -07:00
Krrish Dholakia
585f7b0434 docs(input.md): add litellm params to docs 2023-10-28 19:13:55 -07:00
ishaan-jaff
9e25e6e6b4 (docs) add timeout param 2023-10-20 11:55:42 -07:00
Krrish Dholakia
c09104e577 docs(docs): cleanup 2023-10-13 13:04:22 -07:00
Krrish Dholakia
253e8d27db fix: bug fix when n>1 passed in 2023-10-09 16:46:33 -07:00
Krrish Dholakia
78e413675e docs(completion-docs): add ollama provider specific settings 2023-10-07 13:53:01 -07:00
Krrish Dholakia
d69038883c docs(completion-docs): adds more details on provider-specific params 2023-10-07 13:49:30 -07:00
Krrish Dholakia
306a38880d feat(ollama.py): exposing ollama config 2023-10-06 15:52:58 -07:00
Krrish Dholakia
dd7e397650 style(test_completion.py): fix merge conflict 2023-10-05 22:09:38 -07:00
Krrish Dholakia
95899bf60e add additional param mapping 2023-10-03 21:56:08 -07:00
Krrish Dholakia
430e2698a2 add param mapping to docs 2023-10-03 09:20:58 -07:00
ishaan-jaff
254b0386c4 docs for input 2023-09-22 21:03:39 -07:00
Krrish Dholakia
8015dc2927 adding model alias mapping to docs 2023-08-30 08:00:23 -07:00
ishaan-jaff
41535ec314 bump v 2023-08-17 17:15:16 -07:00
ishaan-jaff
d93ffced09 docs improvements 2023-08-17 16:34:25 -07:00
Krrish Dholakia
dc6e93f0d0 updating docs 2023-08-12 11:30:32 -07:00