Krrish Dholakia
3560f0ef2c
refactor: move all testing to top-level of repo
...
Closes https://github.com/BerriAI/litellm/issues/486
2024-09-28 21:08:14 -07:00
Krish Dholakia
0b30e212da
LiteLLM Minor Fixes & Improvements (09/27/2024) ( #5938 )
...
* fix(langfuse.py): prevent double logging requester metadata
Fixes https://github.com/BerriAI/litellm/issues/5935
* build(model_prices_and_context_window.json): add mistral pixtral cost tracking
Closes https://github.com/BerriAI/litellm/issues/5837
* handle streaming for azure ai studio error
* [Perf Proxy] parallel request limiter - use one cache update call (#5932 )
* fix parallel request limiter - use one cache update call
* ci/cd run again
* run ci/cd again
* use docker username password
* fix config.yml
* fix config
* fix config
* fix config.yml
* ci/cd run again
* use correct typing for batch set cache
* fix async_set_cache_pipeline
* fix only check user id tpm / rpm limits when limits set
* fix test_openai_azure_embedding_with_oidc_and_cf
* fix(groq/chat/transformation.py): Fixes https://github.com/BerriAI/litellm/issues/5839
* feat(anthropic/chat.py): return 'retry-after' headers from anthropic
Fixes https://github.com/BerriAI/litellm/issues/4387
* feat: raise validation error if message has tool calls without passing `tools` param for anthropic/bedrock
Closes https://github.com/BerriAI/litellm/issues/5747
* [Feature]#5940, add max_workers parameter for the batch_completion (#5947 )
* handle streaming for azure ai studio error
* bump: version 1.48.2 → 1.48.3
* docs(data_security.md): add legal/compliance faq's
Make it easier for companies to use litellm
* docs: resolve imports
* [Feature]#5940, add max_workers parameter for the batch_completion method
---------
Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Co-authored-by: Krrish Dholakia <krrishdholakia@gmail.com>
Co-authored-by: josearangos <josearangos@Joses-MacBook-Pro.local>
* fix(converse_transformation.py): fix default message value
* fix(utils.py): fix get_model_info to handle finetuned models
Fixes issue for standard logging payloads, where model_map_value was null for finetuned openai models
* fix(litellm_pre_call_utils.py): add debug statement for data sent after updating with team/key callbacks
* fix: fix linting errors
* fix(anthropic/chat/handler.py): fix cache creation input tokens
* fix(exception_mapping_utils.py): fix missing imports
* fix(anthropic/chat/handler.py): fix usage block translation
* test: fix test
* test: fix tests
* style(types/utils.py): trigger new build
* test: fix test
---------
Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Co-authored-by: Jose Alberto Arango Sanchez <jose.arangos@udea.edu.co>
Co-authored-by: josearangos <josearangos@Joses-MacBook-Pro.local>
2024-09-27 22:52:57 -07:00
Krish Dholakia
a1d9e96b31
LiteLLM Minor Fixes & Improvements (09/25/2024) ( #5893 )
...
* fix(langfuse.py): support new langfuse prompt_chat class init params
* fix(langfuse.py): handle new init values on prompt chat + prompt text templates
fixes error caused during langfuse logging
* docs(openai_compatible.md): clarify `openai/` handles correct routing for `/v1/completions` route
Fixes https://github.com/BerriAI/litellm/issues/5876
* fix(utils.py): handle unmapped gemini model optional param translation
Fixes https://github.com/BerriAI/litellm/issues/5888
* fix(o1_transformation.py): fix o-1 validation, to not raise error if temperature=1
Fixes https://github.com/BerriAI/litellm/issues/5884
* fix(prisma_client.py): refresh iam token
Fixes https://github.com/BerriAI/litellm/issues/5896
* fix: pass drop params where required
* fix(utils.py): pass drop_params correctly
* fix(types/vertex_ai.py): fix generation config
* test(test_max_completion_tokens.py): fix test
* fix(vertex_and_google_ai_studio_gemini.py): fix map openai params
2024-09-26 16:41:44 -07:00
Ishaan Jaff
66eba43f29
mark test_langfuse_masked_input_output
2024-09-07 11:15:29 -07:00
Krrish Dholakia
94db4ec830
test: mark flaky tests
2024-08-30 07:53:04 -07:00
Ishaan Jaff
5f025390bb
test test_image_generation_azure_dall_e_3
2024-08-27 22:52:11 -07:00
Ishaan Jaff
19d57314ee
fix inc langfuse flish time
2024-07-29 20:14:45 -07:00
Ishaan Jaff
285925e10a
log output from /audio on langfuse
2024-07-29 08:21:22 -07:00
Ishaan Jaff
ec28e8e630
test - logging litellm-atranscription
2024-07-29 08:17:19 -07:00
Krrish Dholakia
57607dfc47
test(test_alangfuse.py): fix test to expect correct response object
2024-07-11 09:00:31 -07:00
Ishaan Jaff
cb828a464a
fix langfuse tests in_memory_langfuse_clients
2024-06-22 13:59:36 -07:00
Ishaan Jaff
c44e5a3d93
testing - use in memory langfuse client cache
2024-06-22 13:40:34 -07:00
Ishaan Jaff
b201402b0b
fix testing - we had two files running the exact same langfuse test
2024-06-22 13:32:28 -07:00
Krrish Dholakia
8766a58a16
test(test_alangfuse.py): fix race condition
2024-06-20 10:56:10 -07:00
Krrish Dholakia
9704e1cde0
test(test_alangfuse.py): fix test to flush in order
2024-06-20 10:22:15 -07:00
Krrish Dholakia
ee3e3dfe7d
test(test_alangfuse.py): skip local test
2024-06-19 22:31:16 -07:00
Krrish Dholakia
842b25dd25
test(test_alangfuse.py): delay check
2024-06-19 22:23:10 -07:00
Krrish Dholakia
15c70fb023
test(test_alangfuse.py): fix test
2024-06-19 21:50:02 -07:00
Krrish Dholakia
eed8e88533
test(test_alangfuse.py): fix tests
2024-06-19 21:41:43 -07:00
Ishaan Jaff
dd724990f3
ci/cd run dynamic langfuse tests 1st
2024-06-19 20:54:55 -07:00
Ishaan Jaff
55e3320a50
fix langfuse dynamic logging test
2024-06-19 20:28:16 -07:00
Krrish Dholakia
682ec33aa0
fix(litellm_logging.py): initialize global variables
...
Fixes https://github.com/BerriAI/litellm/issues/4281
2024-06-19 18:39:45 -07:00
Ishaan Jaff
bc051b18d8
test- langfuse prompt
2024-06-18 19:59:34 -07:00
Hannes Burrichter
27df662164
Fix missing Azure api version in Langfuse create_async_task test
2024-06-16 16:09:35 +02:00
Ishaan Jaff
f69c2591b2
fix - redacted by litellm test
2024-06-07 17:02:21 -07:00
Krrish Dholakia
eea1edb973
test(test_alangfuse.py): skip test for this pr
2024-05-21 14:08:05 -07:00
Krrish Dholakia
5d3fe52a08
test: fix test
2024-05-17 22:35:34 -07:00
Alex Epstein
3bf2ccc856
feat(langfuse.py): Allow for individual call message/response redaction
2024-05-12 22:38:29 -04:00
Ishaan Jaff
d3371fc81d
fix langfuse logging metadata
2024-05-11 20:39:44 -07:00
Ishaan Jaff
97c81a5c7e
fix langfuse test
2024-05-11 14:03:40 -07:00
Ishaan Jaff
6577719bf8
fix - langfuse trace
2024-05-11 10:28:13 -07:00
Ishaan Jaff
97ba230b7a
fix langfuse test
2024-05-11 10:20:30 -07:00
Krrish Dholakia
b872da4e6f
test: fix linting error
2024-05-07 13:18:49 -07:00
Alex Epstein
b82162832a
Update support for langfuse metadata
...
- Added ability to set trace release, version, metadata
- Added ability to update fields during a trace continuation
- Added ability to update input and output during a trace continuation
- Wrote new test for verifying metadata is set correctly
- Small improvement to setting secret boolean, prevent unnecessary literal_eval
- Small improvements to langfuse tests
2024-05-05 14:56:36 -04:00
Krrish Dholakia
defc205348
test(test_alangfuse.py): fix test
2024-05-03 12:39:38 -07:00
Krrish Dholakia
18cb0bc530
fix(utils.py): revert pydantic object changes
2024-05-02 08:14:45 -07:00
Krrish Dholakia
caf19478af
fix(utils.py): fix pydantic object default values
2024-05-01 22:51:46 -07:00
Krrish Dholakia
0ab6b4bb22
fix(langfuse.py): fix trace param overwriting when existing trace id is given
2024-05-01 08:44:46 -07:00
Krrish Dholakia
abdae87ba2
fix(langfuse.py): don't overwrite trace details if existing trace id passed in
2024-05-01 08:15:17 -07:00
Ishaan Jaff
743dfdb950
test - redacting messages from langfuse
2024-04-27 10:03:34 -07:00
ishaan-jaff
6e7987c4fc
(beta-test) langfuse embedding
2024-01-31 10:25:19 -08:00
ishaan-jaff
8cf8da1378
(test) langfuse_latency_test_user
2024-01-19 11:38:44 -08:00
ishaan-jaff
2f429f37b7
(test) test latency added with langfuse call
2024-01-19 11:28:10 -08:00
ishaan-jaff
84fbc903aa
(test) langfuse - set custom trace_id
2023-12-30 20:19:22 +05:30
ishaan-jaff
ca8b87915f
(test) langfuse - mark beta test
2023-12-27 18:43:49 +05:30
ishaan-jaff
a16411cf1d
(ci/cd) move langfuse test early
2023-12-27 17:50:44 +05:30
