phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

(docs) langfuse log trace id, trace user id

Browse source
This commit is contained in:
ishaan-jaff 2023-12-30 20:25:23 +05:30
parent 84fbc903aa
commit c269c65371
1 changed files with 37 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

37
docs/my-website/docs/observability/langfuse_integration.md
View file

@ -57,6 +57,8 @@ response = litellm.completion(
## Advanced
### Set Custom Generation names, pass metadata
Pass `generation_name` in `metadata`
```python
import litellm
from litellm import completion
@ -91,6 +93,41 @@ print(response)
```
### Set Custom Trace ID, Trace User ID
Pass `trace_id`, `trace_user_id` in `metadata`
```python
import litellm
from litellm import completion
import os
# from https://cloud.langfuse.com/
os.environ["LANGFUSE_PUBLIC_KEY"] = ""
os.environ["LANGFUSE_SECRET_KEY"] = ""
os.environ['OPENAI_API_KEY']=""
# set langfuse as a callback, litellm will send the data to langfuse
litellm.success_callback = ["langfuse"]
# set custom langfuse trace params and generation params
response = completion(
model="gpt-3.5-turbo",
messages=[
{"role": "user", "content": "Hi 👋 - i'm openai"}
],
metadata={
"generation_name": "ishaan-test-generation", # set langfuse Generation Name
"generation_id": "gen-id22", # set langfuse Generation ID
"trace_id": "trace-id22", # set langfuse Trace ID
"trace_user_id": "user-id2", # set langfuse Trace User ID
},
)
print(response)
```
## Troubleshooting & Errors