Ishaan Jaff
2e9fb5ca1f
Merge pull request #4924 from BerriAI/litellm_log_writing_spend_to_db_otel
...
[Feat] - log writing BatchSpendUpdate events on OTEL
2024-07-27 16:07:56 -07:00
Krrish Dholakia
d1989b6063
fix(utils.py): support fireworks ai finetuned models
...
Fixes https://github.com/BerriAI/litellm/issues/4923
2024-07-27 15:38:27 -07:00
Ishaan Jaff
35ecf3c06b
fix otel test
2024-07-27 15:30:58 -07:00
Krrish Dholakia
05ba34b9b7
fix(utils.py): add exception mapping for databricks errors
2024-07-27 13:13:31 -07:00
Ishaan Jaff
7dac0e0001
fix otel logging
2024-07-27 12:05:24 -07:00
Ishaan Jaff
7c0ea16e3d
test otel for batch_write_to_db
2024-07-27 11:47:17 -07:00
Ishaan Jaff
19fb5cc11c
use common helpers for writing to otel
2024-07-27 11:40:39 -07:00
Ishaan Jaff
f71ba63cab
refactor use common helper
2024-07-27 11:39:03 -07:00
Ishaan Jaff
32eb3bd719
add new BATCH_WRITE_TO_DB type for service logger
2024-07-27 11:36:51 -07:00
Ishaan Jaff
d5d9ed73af
use _get_parent_otel_span_from_kwargs
2024-07-27 11:14:06 -07:00
Ishaan Jaff
2a89486948
move _get_parent_otel_span_from_kwargs to otel.py
2024-07-27 11:12:13 -07:00
Ishaan Jaff
61c10e60a4
feat - use log_to_opentelemetry for _PROXY_track_cost_callback
2024-07-27 11:08:22 -07:00
Krrish Dholakia
1a8f45e8da
build(model_prices_and_context_window.json): add mistral nemo + codestral pricing
2024-07-27 10:46:52 -07:00
Krrish Dholakia
2719860c46
build(model_prices_and_context_window.json): add mistral-large on vertex ai pricing
2024-07-27 10:37:18 -07:00
Ishaan Jaff
3f39e61b15
Merge pull request #4921 from BerriAI/litellm_update_verifying_airgapped_license
...
[Fix] using airgapped license for Enterprise
2024-07-27 09:57:46 -07:00
Ishaan Jaff
1adf71b9b7
feat - clearly show version litellm enterprise
2024-07-27 09:50:03 -07:00
Krish Dholakia
230b0c9a3d
Merge pull request #4920 from idris/patch-2
...
Fix Datadog JSON serialization
2024-07-27 09:46:06 -07:00
Ishaan Jaff
6f428a16fa
fix update public key
2024-07-27 09:45:58 -07:00
Krrish Dholakia
1e621f716f
docs(debugging.md): cleanup docs
2024-07-27 09:28:53 -07:00
Krrish Dholakia
0356decdec
bump: version 1.42.4 → 1.42.5
2024-07-27 09:16:08 -07:00
Idris Mokhtarzada
c2c5877afa
Fix Datadog JSON serialization
...
Nested dicts were not being serialized properly
2024-07-27 02:16:36 -04:00
Krish Dholakia
9bdcef238b
Merge pull request #4907 from BerriAI/litellm_proxy_get_secret
...
fix(proxy_server.py): fix get secret for environment_variables
2024-07-26 22:17:11 -07:00
Krish Dholakia
f9c2fec1a6
Merge pull request #4918 from BerriAI/litellm_ollama_tool_calling
...
feat(ollama_chat.py): support ollama tool calling
2024-07-26 22:16:58 -07:00
Krrish Dholakia
77fe8f57cf
docs(ollama.md): add ollama tool calling to docs
2024-07-26 22:12:52 -07:00
Krrish Dholakia
b25d4a8cb3
feat(ollama_chat.py): support ollama tool calling
...
Closes https://github.com/BerriAI/litellm/issues/4812
2024-07-26 21:51:54 -07:00
Ishaan Jaff
1506e74332
bump: version 1.42.3 → 1.42.4
2024-07-26 21:37:52 -07:00
Ishaan Jaff
36187102d1
Merge pull request #4917 from BerriAI/litellm_link_tomodel_cost
...
[Feat] Link to https://models.litellm.ai/ on Swagger docs and docs
2024-07-26 21:37:04 -07:00
Ishaan Jaff
f03769e2a4
docs fix link https://models.litellm.ai/
2024-07-26 21:35:54 -07:00
Ishaan Jaff
2501b4eccd
feat link to model cost map on swagger
2024-07-26 21:34:42 -07:00
Krrish Dholakia
a264d1ca8c
feat(vertex_httpx.py): support logging citation metadata
...
Closes https://github.com/BerriAI/litellm/issues/3230
2024-07-26 20:54:59 -07:00
Krrish Dholakia
fe7f78fbf6
feat(vertex_httpx.py): support logging vertex ai safety results to langfuse
...
Closes https://github.com/BerriAI/litellm/issues/3230
2024-07-26 20:50:43 -07:00
Ishaan Jaff
a7f964b869
Merge pull request #4913 from BerriAI/litellm_fix_error_limit
...
[Proxy-Fix] - raise more descriptive errors when crossing tpm / rpm limits on keys, user, global limits
2024-07-26 20:25:28 -07:00
Ishaan Jaff
3c463ccbe6
Merge pull request #4914 from BerriAI/litellm_fix_batches
...
[Proxy-Fix + Test] - /batches endpoint
2024-07-26 20:12:03 -07:00
Krrish Dholakia
fe0b55f2ca
fix(utils.py): fix cache hits for streaming
...
Fixes https://github.com/BerriAI/litellm/issues/4109
2024-07-26 19:04:08 -07:00
Ishaan Jaff
f8b9c7128e
docs batches
2024-07-26 18:51:13 -07:00
Ishaan Jaff
90648bee60
docs batches API
2024-07-26 18:50:44 -07:00
Ishaan Jaff
dd37d1d032
use correct link on http://localhost:4000
2024-07-26 18:42:45 -07:00
Ishaan Jaff
f4048bc890
docs batches api
2024-07-26 18:41:53 -07:00
Ishaan Jaff
812dd5e162
test get batches by id
2024-07-26 18:40:10 -07:00
Ishaan Jaff
2541d5f625
add verbose_logger.debug to retrieve batch
2024-07-26 18:26:39 -07:00
Ishaan Jaff
f627fa9b40
fix for GET /v1/batches{batch_id:path}
2024-07-26 18:23:15 -07:00
Ishaan Jaff
12729ceece
test - batches endpoint
2024-07-26 18:09:49 -07:00
Ishaan Jaff
56ce7e892d
fix batches inserting metadata
2024-07-26 18:08:54 -07:00
Ishaan Jaff
159a880dcc
fix /v1/batches POST
2024-07-26 18:06:00 -07:00
Ishaan Jaff
c4e4b4675c
fix raise better error when crossing tpm / rpm limits
2024-07-26 17:35:08 -07:00
Krish Dholakia
c0717133a9
Merge pull request #4909 from idris/fix-datadog-attributes
...
Fix Datadog logging attributes
2024-07-26 14:19:10 -07:00
Idris Mokhtarzada
e8d4234dbd
Better JSON serialization for Datadog logs
...
Dicts are now properly serialized to JSON so that Datadog can parse the child attributes. Also, numbers and nulls are sent as numbers and nulls instead of strings.
2024-07-26 17:02:05 -04:00
Idris Mokhtarzada
a7e877d15f
Use milliseconds for response_time in Datadog logs
...
milliseconds is more commonly used and more standard than seconds
2024-07-26 16:43:21 -04:00
Idris Mokhtarzada
9b89280a90
Use underscores
...
Datadog does not play nice with special characters (as in "(seconds)"). Also just makes sense to standardize on either underscores or camelCase, but not mix-and-match.
2024-07-26 16:38:54 -04:00
Krrish Dholakia
9943c6d607
fix(proxy_server.py): fix get secret for environment_variables
2024-07-26 13:33:02 -07:00
