Ishaan Jaff
|
1ef814dc97
|
use prints
|
2024-08-06 11:07:12 -07:00 |
|
Krish Dholakia
|
036a6821d5
|
Merge pull request #5057 from BerriAI/litellm_rds_iam_auth
feat(proxy_cli.py): support iam-based auth to rds
|
2024-08-06 10:44:33 -07:00 |
|
Krrish Dholakia
|
511f4d33d1
|
feat(utils.py): check env var for api base for openai-compatible endpoints
Closes https://github.com/BerriAI/litellm/issues/5066
|
2024-08-06 08:32:44 -07:00 |
|
Ishaan Jaff
|
d1b8c4e08d
|
forward headers from request
|
2024-08-05 21:45:44 -07:00 |
|
Krrish Dholakia
|
f2fe887e73
|
fix(rds_iam_token.py): support sts based auth
|
2024-08-05 21:01:17 -07:00 |
|
Ishaan Jaff
|
d91b1c93d1
|
use safe init_verbose_loggers
|
2024-08-05 20:56:48 -07:00 |
|
Krrish Dholakia
|
818a70838d
|
fix(user_api_key_auth.py): fix _get_user_role
|
2024-08-05 20:54:27 -07:00 |
|
Krish Dholakia
|
2f304c92e4
|
Merge pull request #5052 from BerriAI/litellm_stability_fixes
fix: bump default allowed_fails + reduce default db pool limit
|
2024-08-05 20:54:23 -07:00 |
|
Ishaan Jaff
|
764b1ed869
|
Merge pull request #5058 from BerriAI/litellm_add_debug_statements_connecting_prisma
Fix - add debug statements when connecting to prisma DB
|
2024-08-05 20:53:55 -07:00 |
|
Ishaan Jaff
|
da848696e3
|
Merge pull request #5059 from BerriAI/litelm_log_otel_args
OTEL - Log DB queries / functions on OTEL
|
2024-08-05 20:51:11 -07:00 |
|
Ishaan Jaff
|
bec0350127
|
otel fix async_service_failure_hook
|
2024-08-05 20:18:40 -07:00 |
|
Ishaan Jaff
|
09105277cd
|
use otel callbacks
|
2024-08-05 20:00:06 -07:00 |
|
Ishaan Jaff
|
8dcea009b8
|
log event_metadata on otel service loggers
|
2024-08-05 19:58:55 -07:00 |
|
Krrish Dholakia
|
5c6dcd6029
|
test: improve debugging for test
|
2024-08-05 19:41:08 -07:00 |
|
Ishaan Jaff
|
8ec184b93f
|
add debugging utils to print when connecting to prisma
|
2024-08-05 19:19:28 -07:00 |
|
Ishaan Jaff
|
a5cd041ccf
|
add debug statements when connected to prisma db
|
2024-08-05 19:13:46 -07:00 |
|
Krrish Dholakia
|
1cc7c7fc59
|
feat(proxy_cli.py): support iam-based auth to rds
Initial pr for iam-based auth support for rds
|
2024-08-05 17:35:48 -07:00 |
|
Ishaan Jaff
|
091449e81b
|
build ui on custom path
|
2024-08-05 16:34:37 -07:00 |
|
Ishaan Jaff
|
900e89c0ad
|
set PROXY_BASE_URL when server root path set
|
2024-08-05 15:48:44 -07:00 |
|
Krrish Dholakia
|
936640948d
|
fix: bump default allowed_fails + reduce default db pool limit
Fixes issues with running proxy server in production
|
2024-08-05 15:07:46 -07:00 |
|
Ishaan Jaff
|
6d2063d1cb
|
fix get_request_route
|
2024-08-05 10:33:40 -07:00 |
|
Ishaan Jaff
|
aa7174c270
|
use get_request_route
|
2024-08-05 10:13:47 -07:00 |
|
Ishaan Jaff
|
13f01ed57f
|
add get_request_route
|
2024-08-05 10:12:34 -07:00 |
|
Krrish Dholakia
|
f610fba58f
|
fix(user_api_key_auth.py): handle older user_role's
Fixes issue where older user_role's (e.g. app_user) weren't being recognized. + Adds testing for it
|
2024-08-05 08:57:06 -07:00 |
|
Krish Dholakia
|
bca71019ad
|
Merge branch 'main' into litellm_anthropic_api_streaming
|
2024-08-03 21:16:50 -07:00 |
|
Krish Dholakia
|
9ba8e3047f
|
Merge branch 'main' into litellm_loadbalancing_test
|
2024-08-03 20:29:54 -07:00 |
|
Krrish Dholakia
|
ac6c39c283
|
feat(anthropic_adapter.py): support streaming requests for /v1/messages endpoint
Fixes https://github.com/BerriAI/litellm/issues/5011
|
2024-08-03 20:16:19 -07:00 |
|
Ishaan Jaff
|
e73eb19678
|
docs default vertex
|
2024-08-03 18:09:48 -07:00 |
|
Ishaan Jaff
|
c8438715af
|
add vertex ai countTokens endpoint
|
2024-08-03 17:34:10 -07:00 |
|
Ishaan Jaff
|
2d5c57e545
|
add vertex embeddings endpoints
|
2024-08-03 17:26:49 -07:00 |
|
Ishaan Jaff
|
c98733863a
|
add vertex generateContent
|
2024-08-03 17:17:54 -07:00 |
|
Ishaan Jaff
|
8051781af0
|
working code for vertex ai routes
|
2024-08-03 16:56:33 -07:00 |
|
Ishaan Jaff
|
64c008045f
|
use native endpoints
|
2024-08-03 16:52:43 -07:00 |
|
Ishaan Jaff
|
af04bbecca
|
set native vertex endpoints
|
2024-08-03 16:52:03 -07:00 |
|
Krrish Dholakia
|
6b8806b45f
|
feat(router.py): add flag for mock testing loadbalancing for rate limit errors
|
2024-08-03 12:34:11 -07:00 |
|
Ishaan Jaff
|
19474c3f0f
|
support v1/projects/tuningJobs
|
2024-08-03 11:46:39 -07:00 |
|
Ishaan Jaff
|
9dffe23108
|
Merge pull request #5030 from BerriAI/litellm_add_vertex_ft_proxy
[Feat] Add support for Vertex AI Fine tuning on LiteLLM Proxy
|
2024-08-03 08:29:11 -07:00 |
|
Ishaan Jaff
|
7fe46ac0ce
|
add vertex example on config.yaml
|
2024-08-03 08:26:59 -07:00 |
|
Ishaan Jaff
|
4fc27e87c5
|
add vertex ai ft on proxy
|
2024-08-02 18:26:36 -07:00 |
|
Krrish Dholakia
|
5d96ff6694
|
fix(utils.py): handle scenario where model="azure/*" and custom_llm_provider="azure"
Fixes https://github.com/BerriAI/litellm/issues/4912
|
2024-08-02 17:48:53 -07:00 |
|
Krrish Dholakia
|
186e5f55e8
|
fix(user_api_key_auth.py): fix linting errors
|
2024-08-02 16:34:32 -07:00 |
|
Krrish Dholakia
|
1080c7014e
|
build(ui): allow admin_viewer to view teams tab
Allows admin viewe role to see available teams on proxy ui
|
2024-08-02 16:19:40 -07:00 |
|
Krrish Dholakia
|
f506eb341b
|
feat(litellm_logging.py): log exception response headers to langfuse
|
2024-08-01 18:07:47 -07:00 |
|
Ishaan Jaff
|
6c899ced28
|
init gcs using gcs_bucket
|
2024-08-01 18:07:38 -07:00 |
|
Ishaan Jaff
|
3ff07dfb14
|
use itellm.forward_traceparent_to_llm_provider
|
2024-08-01 18:07:38 -07:00 |
|
Ishaan Jaff
|
e32c1f4c9b
|
ui new build
|
2024-08-01 18:07:38 -07:00 |
|
Krrish Dholakia
|
10b571ca42
|
fix(litellm_logging.py): use 1 cost calc function across response headers + logging integrations
Ensures consistent cost calculation when azure base models are used
|
2024-08-01 10:26:59 -07:00 |
|
Krrish Dholakia
|
d02d3d9712
|
build(model_prices_and_context_window.json): add azure gpt-4o-mini regional + global standard pricing to model cost map
|
2024-08-01 09:44:40 -07:00 |
|
Krrish Dholakia
|
d8a8cd2961
|
feat(ui): add ability to enable traceloop + langsmith via ui
|
2024-07-31 21:40:29 -07:00 |
|
Krrish Dholakia
|
d914aa558d
|
feat(ui): add braintrust logging to ui
|
2024-07-31 21:15:19 -07:00 |
|