Krrish Dholakia
e7b3ac8e06
feat(openmeter.py): add support for user billing
...
open-meter supports user based billing. Closes https://github.com/BerriAI/litellm/issues/1268
2024-05-01 17:23:48 -07:00
Krrish Dholakia
733c1cd134
fix(langfuse.py): fix trace param overwriting when existing trace id is given
2024-05-01 08:44:46 -07:00
Krrish Dholakia
c29ae2765a
fix(langfuse.py): don't overwrite trace details if existing trace id passed in
2024-05-01 08:15:17 -07:00
Marc Klingen
4564512c67
Merge branch 'main' into patch-1
2024-05-01 15:19:25 +02:00
Krrish Dholakia
701be55872
feat(utils.py): json logs for raw request sent by litellm
...
make it easier to view verbose logs in datadog
2024-04-29 19:21:19 -07:00
Krrish Dholakia
b4ddbb2203
fix(langfuse.py): support 'existing_trace_id' param
...
allow user to call out a trace as pre-existing, this prevents creating a default trace name, and potentially overwriting past traces
2024-04-29 16:39:17 -07:00
Krrish Dholakia
82e24bd350
fix(langfuse.py): don't set default trace_name if trace_id given
2024-04-29 16:39:17 -07:00
Ishaan Jaff
fb40f8001b
Merge pull request #3338 from BerriAI/litellm_alerting_sort_latencies
...
Fix - slack alerting show deployment latencies in sorted order
2024-04-27 18:40:07 -07:00
Ishaan Jaff
b87badce7b
fix slack alerting show deployment latencies
2024-04-27 15:44:30 -07:00
Ishaan Jaff
3e30f566ff
fix - link to langfuse traces on slack alerts
2024-04-27 15:23:18 -07:00
Ishaan Jaff
de36ffa292
fix - allow langfuse init with flush interval
2024-04-27 14:53:18 -07:00
Krish Dholakia
f9814105f7
Merge pull request #3310 from BerriAI/litellm_langfuse_error_logging_2
...
fix(proxy/utils.py): log rejected proxy requests to langfuse
2024-04-25 19:49:59 -07:00
Ishaan Jaff
1dbf666f4b
Merge pull request #3301 from BerriAI/debug_lowest_latency
...
[Fix] sending deployment latencies to slack alerting - lowest_latency
2024-04-25 19:43:25 -07:00
Ishaan Jaff
6c8998d6ca
fix clean up prints from slack alerting
2024-04-25 19:36:42 -07:00
Krrish Dholakia
462724feef
fix(proxy/utils.py): log rejected proxy requests to langfuse
2024-04-25 19:26:27 -07:00
Ishaan Jaff
2190b039fd
pass alert type on alerting handle
2024-04-25 13:05:34 -07:00
Ishaan Jaff
3b9d6dfc47
temp - show better debug logs for lowest latency
2024-04-25 11:22:52 -07:00
Ishaan Jaff
ad637c15ce
Merge pull request #3283 from BerriAI/litellm_debug_lowest_latency
...
[Fix] Add better observability for debugging lowest latency routing
2024-04-24 20:42:52 -07:00
Ishaan Jaff
24285df371
temp fix _add_langfuse_trace_id_to_alert
2024-04-24 20:19:21 -07:00
Ishaan Jaff
1c109086ac
fix - add _get_deployment_latencies_to_alert
2024-04-24 20:09:02 -07:00
Krrish Dholakia
cbcb3318f4
fix(langfuse.py): fix langfuse environ check
2024-04-24 13:21:00 -07:00
Krish Dholakia
157099dd9e
Merge pull request #3098 from greenscale-ai/main
...
Support for Greenscale AI logging
2024-04-24 13:09:03 -07:00
Krrish Dholakia
17bf753309
fix(prometheus.py): fix user-id get for prometheus
2024-04-24 08:08:42 -07:00
Krrish Dholakia
5da7946d43
fix(langsmith.py): fix streaming langsmith calls
2024-04-23 20:47:19 -07:00
Krish Dholakia
52add6bf6a
Merge pull request #3250 from BerriAI/litellm_caching_no_cache_fix
...
fix(utils.py): fix 'no-cache': true when caching is turned on
2024-04-23 19:57:07 -07:00
Ishaan Jaff
baab663b41
fix - slack alerting use one httpx client for alerts
2024-04-23 18:47:39 -07:00
Ishaan Jaff
afdefca4ab
fix - use one slack class
2024-04-23 18:31:15 -07:00
Krrish Dholakia
04014c752b
fix(utils.py): fix 'no-cache': true when caching is turned on
2024-04-23 12:58:30 -07:00
Ishaan Jaff
a3109db4e1
fix langfuse project id
2024-04-23 11:37:17 -07:00
Krrish Dholakia
49852b68c1
fix(prometheus.py): add user tracking to prometheus
2024-04-22 15:14:38 -07:00
Krrish Dholakia
1ca2439eb7
fix(lowest_tpm_rpm_v2.py): use a combined tpm+rpm query in async get cache, to reduce redis client calls in high traffic
2024-04-20 16:13:11 -07:00
Krish Dholakia
a9dc93e860
Merge branch 'main' into litellm_ssl_caching_fix
2024-04-19 17:20:27 -07:00
Krish Dholakia
d0c58f2b55
Merge pull request #3179 from BerriAI/litellm_dual_caching_fix
...
fix(caching.py): dual cache async_batch_get_cache fix + testing
2024-04-19 17:02:47 -07:00
Ishaan Jaff
d86da2db32
fix - logging proxy base url to langfuse
2024-04-19 16:20:46 -07:00
Krrish Dholakia
b3a8c2885b
test(test_prometheus_services.py): fix testing to handle caching ping in init
2024-04-19 16:15:29 -07:00
Ishaan Jaff
57fd49d1e8
fix - allow users to opt into langfuse default tags
2024-04-19 16:05:31 -07:00
Ishaan Jaff
a1e2a2e540
feat - log base_url to langfuse as a tag
2024-04-19 15:48:00 -07:00
Ishaan Jaff
5b31a5c754
Merge pull request #3175 from BerriAI/litellm_log_team_alias_langfuse
...
[FEAT] Log team alias to langfuse
2024-04-19 15:30:59 -07:00
Krrish Dholakia
5da934099f
fix(caching.py): dual cache async_batch_get_cache fix + testing
...
this fixes a bug in usage-based-routing-v2 which was caused b/c of how the result was being returned from dual cache async_batch_get_cache. it also adds unit testing for that function (and it's sync equivalent)
2024-04-19 15:03:25 -07:00
Ishaan Jaff
92422a6a67
fix - use user_api_key_team_alias as the default tag on langfuse
2024-04-19 14:43:41 -07:00
Ishaan Jaff
c7def19107
langfuse - log team alias
2024-04-19 14:26:58 -07:00
Krrish Dholakia
7065e4ee12
fix(caching.py): remove url parsing logic - causing redis ssl connections to fail
...
this reverts a change that was causing redis url w/ ssl to fail. this also adds unit testing for this sc
enario, to prevent future regressions
2024-04-19 14:01:13 -07:00
Ishaan Jaff
87548d9763
Merge pull request #2961 from Manouchehri/langfuse-add-region-2937
...
(feat) Langfuse - Add location logging, and add cache_hit to metadata.
2024-04-19 10:06:34 -07:00
Krrish Dholakia
376ee4e9d7
fix(test_lowest_tpm_rpm_routing_v2.py): unit testing for usage-based-routing-v2
2024-04-18 21:38:00 -07:00
Krrish Dholakia
7f5bcf38b7
feat(prometheus_services.py): emit proxy latency for successful llm api requests
...
uses prometheus histogram for this
2024-04-18 16:04:35 -07:00
Krrish Dholakia
f6ac469573
fix(prometheus.py): fix metric name to be more accurate
...
change metric name from litellm_failed_requests_metric to litellm_llm_api_failed_requests_metric
2024-04-18 12:30:44 -07:00
Krrish Dholakia
deccde6be1
fix(utils.py): support prometheus failed call metrics
2024-04-18 12:29:15 -07:00
greenscale-nandesh
86ac589bdd
Merge branch 'BerriAI:main' into main
2024-04-17 12:24:29 -07:00
Ishaan Jaff
3dca830fcb
fix don't log user_api_key to prometheus
2024-04-16 19:01:38 -07:00
greenscale-nandesh
334772b922
Merge branch 'BerriAI:main' into main
2024-04-16 11:49:26 -07:00
