Krrish Dholakia
d9539e518e
build(docker-compose.yml): add prometheus scraper to docker compose
...
persists prometheus data across restarts
2024-07-24 10:09:23 -07:00
Ishaan Jaff
ac7f6598f3
Merge pull request #4853 from BerriAI/litellm_support_tags
...
[Feat] - Support Logging tags on langsmith
2024-07-24 09:51:56 -07:00
Ishaan Jaff
9c2c231c7c
Merge pull request #4857 from Manouchehri/improve-oidc-tests-5
...
(test_embedding.py) - Re-enable embedding test with Azure OIDC.
2024-07-24 09:48:01 -07:00
Ishaan Jaff
691c1a5355
Merge pull request #4848 from Manouchehri/llama-3.1-bedrock-1
...
Add Llama 3.1 for Bedrock
2024-07-24 09:47:32 -07:00
David Manouchehri
ced03d9d7f
(test_embedding.py) - Re-enable embedding test with Azure OIDC.
2024-07-24 16:41:24 +00:00
Krish Dholakia
035d03c7f2
Merge pull request #4856 from msabramo/fix-test_prompt_factory-flake8-warning
...
Fix `test_prompt_factory` flake8 warning
2024-07-24 09:38:48 -07:00
Marc Abramowitz
a50fe3e1ca
Fix test_prompt_factory flake8 warning
...
```shell
$ poetry run flake8 litellm/tests/test_prompt_factory.py
<unknown>:215: SyntaxWarning: invalid escape sequence '\/'
litellm/tests/test_prompt_factory.py:215:21: W605 invalid escape sequence '\/'
```
Fixed by making the string a raw string, which is equivalent:
```
$ python
Python 3.11.6 (main, Oct 25 2023, 19:49:20) [Clang 14.0.0 (clang-1400.0.29.202)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> "data:image\/jpeg;base64,1234" == r"data:image\/jpeg;base64,1234"
True
```
See: https://stackoverflow.com/questions/52335970/how-to-fix-syntaxwarning-invalid-escape-sequence-in-python
2024-07-24 09:14:22 -07:00
Ishaan Jaff
d06229d168
Merge pull request #4855 from Manouchehri/improve-oidc-tests-4
...
(test_secret_manager.py) - Improve and add CircleCI v1 test with Amazon.
2024-07-24 09:13:48 -07:00
David Manouchehri
c364a3129e
(test_secret_manager.py) - Improve and add CircleCI v1 test with Amazon.
2024-07-24 16:05:58 +00:00
Ishaan Jaff
f325e29147
Merge pull request #4854 from Manouchehri/oidc-azure-tests-3
...
OIDC azure tests 3
2024-07-24 08:53:53 -07:00
Ishaan Jaff
b5d580752d
Merge pull request #4843 from elabbarw/main
...
feat - Add Azure_AI Llama v3.1 API deployments to the model prices json file
2024-07-24 08:53:29 -07:00
Wanis Elabbar
1350ac217d
Merge pull request #3 from elabbarw/elabbarw-llamav31prices
...
update azure_ai llamav31 prices with sources
2024-07-24 16:50:35 +01:00
Wanis Elabbar
77cf1fd600
update azure_ai llamav31 prices with sources
2024-07-24 16:50:07 +01:00
David Manouchehri
4b89397136
(tests) - Skip embedding Azure AD test for now.
2024-07-24 15:42:57 +00:00
David Manouchehri
af3a900b4d
(tests) - Try azure AD auth directly.
2024-07-24 15:42:40 +00:00
Krish Dholakia
bd9486501d
Merge pull request #4846 from msabramo/speed-up-check_view_exists
...
Check existence of multiple views in 1 query
2024-07-24 08:06:04 -07:00
Krrish Dholakia
41fda47587
test(test_embedding.py): fix base url
2024-07-24 08:04:27 -07:00
Ishaan Jaff
cea8fcc3fc
test - logging langsmith tags
2024-07-24 07:12:45 -07:00
Ishaan Jaff
e378ab8bc9
docs - logging langsmith tags
2024-07-24 07:12:36 -07:00
Ishaan Jaff
adfd6ab900
langsmith - support logging tags
2024-07-24 07:08:40 -07:00
Wanis Elabbar
e370b0cde3
Merge branch 'BerriAI:main' into main
2024-07-24 08:32:49 +01:00
David Manouchehri
609075bd17
Add Llama 3.1 for Bedrock.
2024-07-24 05:48:23 +00:00
Marc Abramowitz
642f1a7bcc
Check existence of multiple views in 1 query
...
instead of multiple queries. This is more efficient because it lets us check for
all views in one query instead of multiple queries.
2024-07-23 21:55:02 -07:00
Krrish Dholakia
d5d2ffffdf
bump: version 1.41.28 → 1.42.0
2024-07-23 21:54:06 -07:00
Krish Dholakia
6c580ac8dc
Merge pull request #4845 from BerriAI/litellm_vertex_ai_llama3_1_api
...
feat(vertex_ai_llama.py): vertex ai llama3.1 api support
2024-07-23 21:51:46 -07:00
Krrish Dholakia
fb0a13c8bb
fix(anthropic.py): support openai system message being a list
2024-07-23 21:45:56 -07:00
Krrish Dholakia
ae693424e4
fix(__init__.py): update init
2024-07-23 17:55:28 -07:00
Krrish Dholakia
7df94100e8
build(model_prices_and_context_window.json): add model pricing for vertex ai llama 3.1 api
2024-07-23 17:36:07 -07:00
Krrish Dholakia
83ef52e180
feat(vertex_ai_llama.py): vertex ai llama3.1 api support
...
Initial working commit for vertex ai llama 3.1 api support
2024-07-23 17:07:30 -07:00
Krish Dholakia
cb4c42e061
Merge pull request #4839 from Manouchehri/azure-oidc-test-1
...
Add test for Azure OIDC auth
2024-07-23 17:01:00 -07:00
Ishaan Jaff
83b13d34ba
bump: version 1.41.27 → 1.41.28
2024-07-23 16:48:50 -07:00
Ishaan Jaff
e9d6816011
Merge pull request #4838 from BerriAI/doc_anthropic_proxy_usage
...
doc - using anthropic with litellm proxy server
2024-07-23 16:38:09 -07:00
Ishaan Jaff
92708a2737
Merge pull request #4841 from BerriAI/litellm_anthropic_cost_tracking
...
[Feat] - /v1/messages support usage tracking on spendLogs
2024-07-23 16:37:42 -07:00
Ishaan Jaff
d13aa698ea
Merge pull request #4844 from BerriAI/litellm_accept_null_values_spend_logs
...
[Fix-Proxy] Spend Tracking - accept null values for api_base (optional fields) in SpendLogs
2024-07-23 16:37:08 -07:00
Ishaan Jaff
78eb5164df
fix DB accept null values for api_base, user, etc
2024-07-23 16:33:04 -07:00
Wanis Elabbar
b8183bf42c
Merge pull request #2 from elabbarw/azureaillama31
...
feat - add azure_ai llama v3.1 8B 70B and 405B to model prices json
2024-07-24 00:00:41 +01:00
Wanis Elabbar
e14ef3eeda
feat - add azure_ai llama v3.1 8B 70B and 405B
2024-07-23 23:57:50 +01:00
Krrish Dholakia
169da8b8d0
docs(guardrails.md): add team-based controls to guardrails
2024-07-23 15:39:21 -07:00
Ishaan Jaff
a71b60d005
Pass litellm proxy specific metadata
2024-07-23 15:31:30 -07:00
Ishaan Jaff
4c1ee1e282
fix add better debugging _PROXY_track_cost_callback
2024-07-23 15:25:46 -07:00
Ishaan Jaff
c3d90f9aee
test_anthropic_completion_input_translation_with_metadata
2024-07-23 15:23:58 -07:00
David Manouchehri
2dcd9a5567
(test - azure): Add test for Azure OIDC auth.
2024-07-23 19:12:40 +00:00
Krrish Dholakia
f64a3309d1
fix(utils.py): support raw response headers for streaming requests
2024-07-23 11:58:58 -07:00
Krrish Dholakia
d1ffb4de5f
docs(raw_request_response.md): show how to get openai headers from response
2024-07-23 11:40:26 -07:00
Krrish Dholakia
dcb974dd1e
feat(utils.py): support passing openai response headers to client, if enabled
...
Allows openai/openai-compatible provider response headers to be sent to client, if 'return_response_headers' is enabled
2024-07-23 11:30:52 -07:00
Ishaan Jaff
b137207ae6
doc alert_to_webhook_url
2024-07-23 11:04:15 -07:00
Ishaan Jaff
aba600a892
fix triton linting
2024-07-23 11:03:34 -07:00
Ishaan Jaff
8845bd4d76
doc - using anthropic with litellm proxy server
2024-07-23 10:42:17 -07:00
Krrish Dholakia
a8c88dad64
docs(sidebar.js): add oidc to left nav
2024-07-23 10:37:06 -07:00
Krish Dholakia
5382242f4b
Merge pull request #4836 from Manouchehri/oidc-docs-1
...
(docs): Add OIDC doc.
2024-07-23 10:34:37 -07:00
