Commit graph

19 commits

Author SHA1 Message Date
Krish Dholakia
2cab33b061 LiteLLM Minor Fixes and Improvements (08/06/2024) (#5567)
* fix(utils.py): return citations for perplexity streaming

Fixes https://github.com/BerriAI/litellm/issues/5535

* fix(anthropic/chat.py): support fallbacks for anthropic streaming (#5542)

* fix(anthropic/chat.py): support fallbacks for anthropic streaming

Fixes https://github.com/BerriAI/litellm/issues/5512

* fix(anthropic/chat.py): use module level http client if none given (prevents early client closure)

* fix: fix linting errors

* fix(http_handler.py): fix raise_for_status error handling

* test: retry flaky test

* fix otel type

* fix(bedrock/embed): fix error raising

* test(test_openai_batches_and_files.py): skip azure batches test (for now) quota exceeded

* fix(test_router.py): skip azure batch route test (for now) - hit batch quota limits

---------

Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>

* All `model_group_alias` should show up in `/models`, `/model/info` , `/model_group/info` (#5539)

* fix(router.py): support returning model_alias model names in `/v1/models`

* fix(proxy_server.py): support returning model alias'es on `/model/info`

* feat(router.py): support returning model group alias for `/model_group/info`

* fix(proxy_server.py): fix linting errors

* fix(proxy_server.py): fix linting errors

* build(model_prices_and_context_window.json): add amazon titan text premier pricing information

Closes https://github.com/BerriAI/litellm/issues/5560

* feat(litellm_logging.py): log standard logging response object for pass through endpoints. Allows bedrock /invoke agent calls to be correctly logged to langfuse + s3

* fix(success_handler.py): fix linting error

* fix(success_handler.py): fix linting errors

* fix(team_endpoints.py): Allows admin to update team member budgets

---------

Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
2024-09-06 17:16:24 -07:00
Krrish Dholakia
b08492bc29 fix(s3.py): fix s3 logging payload to have valid json values
Previously pydantic objects were being stringified, making them unparsable
2024-08-15 17:09:02 -07:00
Krrish Dholakia
b6f509a745 fix(s3.py): fix s3 path logging on proxy 2024-07-01 17:22:31 -07:00
Krrish Dholakia
e391e30285 refactor: replace 'traceback.print_exc()' with logging library
allows error logs to be in json format for otel logging
2024-06-06 13:47:43 -07:00
Krrish Dholakia
926b86af87 feat(bedrock_httpx.py): moves to using httpx client for bedrock cohere calls 2024-05-11 13:43:08 -07:00
Krrish Dholakia
5f93cae3ff feat(proxy_server.py): return litellm version in response headers 2024-05-08 16:00:08 -07:00
ishaan-jaff
0ea0566f20 (fix) high traffic langfuse, s3 2024-03-06 12:22:52 -08:00
ishaan-jaff
2e4b1bcf4d (feat) use same id to log on s3, langfuse 2024-02-02 16:26:59 -08:00
David Manouchehri
220bf0de6b s3 logger - Improve filename to allow easier sorting. 2024-02-02 11:29:13 -05:00
ishaan-jaff
587e73697f s3 logger - add better debug statements 2024-01-25 18:47:50 -08:00
ishaan-jaff
a336628355 (fix) s3 log .json files 2024-01-25 18:36:20 -08:00
ishaan-jaff
78b72d431b (fix) s3 logger use r2 links 2024-01-25 18:36:20 -08:00
Duarte OC
a124bbc8db revert comment 2024-01-18 17:26:38 +01:00
Duarte OC
442511311b Update s3 cache to support folder 2024-01-18 11:38:05 +01:00
ishaan-jaff
0da0909f2d (feat) s3 logging - log cache hits 2024-01-11 15:57:54 +05:30
ishaan-jaff
ae8b6b31e2 (fix) s3 log cache hits 2024-01-11 11:44:20 +05:30
ishaan-jaff
4a47b17ba2 (feat) proxy - support s3_callback_params 2024-01-11 09:57:47 +05:30
ishaan-jaff
426ce91481 (fix) working s3 logging 2024-01-11 08:57:32 +05:30
ishaan-jaff
a7fe37599e v0 2024-01-11 08:25:40 +05:30