Commit graph

176 commits

Author SHA1 Message Date
Krrish Dholakia
49847347d0 fix(llm_guard.py): add streaming hook for moderation calls 2024-02-20 20:31:32 -08:00
Krrish Dholakia
2a4a6995ac feat(llama_guard.py): add llama guard support for content moderation + new async_moderation_hook endpoint 2024-02-16 18:45:25 -08:00
Krrish Dholakia
f57483ea70 fix(utils.py): support image gen logging to langfuse 2024-02-16 16:12:52 -08:00
Krish Dholakia
70146c1d37
Merge pull request #1995 from BerriAI/litellm_langfuse_prompts
feat(langfuse.py): support langfuse prompt management
2024-02-15 23:57:00 -08:00
Krrish Dholakia
dbb2939b98 feat(langfuse.py): support langfuse prompt management 2024-02-15 21:21:30 -08:00
ishaan-jaff
039617766f (feat) track team_id in langfuse tags 2024-02-15 20:58:39 -08:00
Krrish Dholakia
59981a5a03 fix: fix merge issues 2024-02-13 23:04:12 -08:00
Krish Dholakia
f5c989cb83
Merge branch 'main' into litellm_fix_pii_output_parsing 2024-02-13 22:36:17 -08:00
Krrish Dholakia
f68b656040 feat(presidio_pii_masking.py): enable output parsing for pii masking 2024-02-13 21:36:57 -08:00
Krish Dholakia
fa74adb041
Merge pull request #1955 from BerriAI/litellm_streaming_post_call_rules_2
feat(utils.py): enable post call rules for streaming
2024-02-13 19:18:29 -08:00
ishaan-jaff
b2d861fa11 (fix) langfuse logging 2024-02-13 07:02:58 -08:00
Krrish Dholakia
7600c8f41d feat(utils.py): enable post call rules for streaming 2024-02-12 22:08:04 -08:00
deena
b640ec4dc0 support langfuse tags feature 2024-02-12 19:49:11 +02:00
Krrish Dholakia
64fd1f7d21 fix(langfuse.py): langfuse success logging fix 2024-02-08 16:46:04 -08:00
Krrish Dholakia
bc23a9266e fix(langfuse.py): support passing input params for langfuse errors 2024-02-08 16:37:33 -08:00
Krrish Dholakia
b6adeec347 fix(proxy_server.py): prisma client fixes for high traffic 2024-02-06 17:30:36 -08:00
ishaan-jaff
a6afba8cf2 (fix) langfuse show semantic-similarity in tags 2024-02-06 13:41:22 -08:00
ishaan-jaff
3da30383f5 (feat) show langfuse logging tags better through proxy 2024-02-06 13:09:48 -08:00
Krrish Dholakia
a1bbb16ab2 fix(langfuse.py): support logging failed llm api calls to langfuse 2024-02-05 16:16:15 -08:00
David Manouchehri
26e68c3f67
(feat) Add sessionId for Langfuse. 2024-02-05 15:13:21 -05:00
ishaan-jaff
d69edac11b (feat) use same id to log on s3, langfuse 2024-02-02 16:26:59 -08:00
Krrish Dholakia
31b19a420f fix(helicone.py): fix logging 2024-02-02 14:30:01 -08:00
ishaan-jaff
9947b0db96 (fix) langfuse - use exact same response_id as s3 logging 2024-02-02 14:29:23 -08:00
ishaan-jaff
553349cb18 (fix) langfuse logging, append time to logs 2024-02-02 14:20:02 -08:00
ishaan-jaff
9657fb0f0c (feat) langfuse set generation_id to response ID 2024-02-02 13:06:47 -08:00
David Manouchehri
cb1990cabc
s3 logger - Improve filename to allow easier sorting. 2024-02-02 11:29:13 -05:00
Krrish Dholakia
a301d8aa4b feat(utils.py): support dynamic langfuse params and team settings on proxy 2024-02-01 21:08:24 -08:00
Krish Dholakia
e6231245c1
Merge pull request #1704 from maxdeichmann/add-langfuse-cost-tracking
feat: add langfuse cost tracking
2024-01-31 16:09:50 -08:00
Krrish Dholakia
345d0029af fix(langfuse.py): use total_cost 2024-01-31 16:04:56 -08:00
ishaan-jaff
a6d7e54cda (feat) log raw llm api calls on langfuse 2024-01-31 11:12:07 -08:00
ishaan-jaff
71e14cbbda (fix) langfuse check for embedding 2024-01-31 10:28:18 -08:00
ishaan-jaff
f4def61a90 (feat) langfuse - log embeddings 2024-01-31 10:22:29 -08:00
Max Deichmann
926bdae955 push 2024-01-31 13:57:48 +01:00
Max Deichmann
f0aeedb25d add cost tracking 2024-01-31 13:41:54 +01:00
ishaan-jaff
933c693e9b s3 logger - add better debug statements 2024-01-25 18:47:50 -08:00
ishaan-jaff
347bab7786 (fix) s3 log .json files 2024-01-25 18:36:20 -08:00
ishaan-jaff
7179d0cb48 (fix) s3 logger use r2 links 2024-01-25 18:36:20 -08:00
Krrish Dholakia
09b7235b31 fix: support info level logging on pkg + proxy 2024-01-20 17:45:47 -08:00
Ishaan Jaff
b2b41727ce
Merge pull request #1524 from timothyasp/langsmith-project-env-bug-fix
Langsmith: Add envs for project/run names; fix bug with None metadata
2024-01-19 14:04:16 -08:00
Tim Asp
9d6a8b5de3 Cleaner fallback 2024-01-19 11:56:45 -08:00
ishaan-jaff
cb99cd18e7 (feat) log cache_hit as langfuse tags 2024-01-19 11:38:18 -08:00
Tim Asp
27087e5662 fix error when metadata is none, prevents logging silently 2024-01-19 11:37:45 -08:00
Tim Asp
141d2219e2 Add env for project wide langsmith default project settings 2024-01-19 11:37:15 -08:00
Duarte OC
dbadd64395 revert comment 2024-01-18 17:26:38 +01:00
Duarte OC
578256a6a2
Update s3 cache to support folder 2024-01-18 11:38:05 +01:00
ishaan-jaff
5c1ae3d412 (feat) langfuse send metadata as tags 2024-01-17 17:29:46 -08:00
ishaan-jaff
1d9dad4af4 (feat) s3 logging - log cache hits 2024-01-11 15:57:54 +05:30
ishaan-jaff
ce426f8b07 (fix) s3 log cache hits 2024-01-11 11:44:20 +05:30
ishaan-jaff
0b20ab7d2b (feat) proxy - support s3_callback_params 2024-01-11 09:57:47 +05:30
ishaan-jaff
f61d8596e1 (fix) working s3 logging 2024-01-11 08:57:32 +05:30