phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity
9378 commits 1603 branches 645 tags 320 MiB
Commit graph

9378 commits

This branch
This branch
All branches
Author SHA1 Message Date
Krrish Dholakia
a5776a3054 test(test_custom_logger.py): cleanup test 2024-03-25 18:32:12 -07:00
Ishaan Jaff
553ac19f9f (feat) improve cache debugging litellm 2024-03-25 18:26:58 -07:00
Krrish Dholakia
1ac641165b fix(utils.py): persist response id across chunks 2024-03-25 18:20:43 -07:00
Ishaan Jaff
3fcab0137a (test) batch writing to cache 2024-03-25 18:04:04 -07:00
Ishaan Jaff
32d4756943 (fix) print verbose in batch writing redis 2024-03-25 18:02:31 -07:00
Krrish Dholakia
dc2c4af631 fix(utils.py): fix text completion streaming 2024-03-25 16:47:17 -07:00
Ishaan Jaff
7134d66fae
Merge branch 'main' into litellm_batch_write_redis_cache 2024-03-25 16:41:29 -07:00
Ishaan Jaff
abce689862 (feat) batch write redis cache output 2024-03-25 16:39:47 -07:00
Krrish Dholakia
9e1e97528d fix(utils.py): ensure last chunk is always empty delta w/ finish reason 
makes sure we're openai-compatible with our streaming. Adds stricter tests for this as well
 2024-03-25 16:33:41 -07:00
Ishaan Jaff
4ae51e9fd5 (fix) locust load test use uuid 2024-03-25 15:36:30 -07:00
Ishaan Jaff
37aadba959 (feat) v0 batch redis cache writes 2024-03-25 15:20:10 -07:00
Krrish Dholakia
f153889738 fix(utils.py): allow user to disable streaming logging 
fixes event loop issue for litellm.disable_streaming_logging
 2024-03-25 14:28:46 -07:00
Krrish Dholakia
16ade7e556 docs(proxy/caching.md): add ttl param to proxy/caching.md 2024-03-25 13:46:52 -07:00
Krrish Dholakia
591a0a376e fix(caching.py): support default ttl for caching 2024-03-25 13:40:17 -07:00
dependabot[bot]
9323f1439f
build(deps): bump express from 4.18.2 to 4.19.2 in /docs/my-website 
Bumps [express](https://github.com/expressjs/express) from 4.18.2 to 4.19.2.
- [Release notes](https://github.com/expressjs/express/releases)
- [Changelog](https://github.com/expressjs/express/blob/master/History.md)
- [Commits](https://github.com/expressjs/express/compare/4.18.2...4.19.2)

---
updated-dependencies:
- dependency-name: express
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-03-25 20:31:36 +00:00
Krrish Dholakia
e1c75c009f bump: version 1.34.1 → 1.34.2 2024-03-25 13:28:25 -07:00
Krish Dholakia
f15ba10170
Merge pull request #2687 from BerriAI/litellm_jwt_auth_fixes_2 
Litellm jwt auth fixes
 2024-03-25 13:27:19 -07:00
Krrish Dholakia
2e4e97a48f test(test_jwt.py): add unit tests for jwt auth integration 2024-03-25 13:24:39 -07:00
Krrish Dholakia
03b8444d3c docs(token_auth.md): add renaming jwt scope string to docs 2024-03-25 12:49:44 -07:00
Krish Dholakia
e5be002adc
Merge pull request #2660 from dragosMC91/fix-pip-install-extra-proxy 
Fix pip install 'litellm[extra_proxy]'
 2024-03-25 12:42:13 -07:00
Krrish Dholakia
c2ffb83c71 fix(handle_jwt.py): cache public keys 
caches jwt public keys - reducing need for making http calls on every request
 2024-03-25 12:36:32 -07:00
Ishaan Jaff
71c3484b93
Merge pull request #2683 from BerriAI/litellm_f_string 
(feat) Perf Improvement - stop eagerly evaluating fstring
 2024-03-25 12:35:30 -07:00
Krrish Dholakia
f1b1640a31 fix(handle_jwt.py): support scopes being a list 
allow scopes in jwt to be a list, not just a space-separated string
 2024-03-25 12:30:40 -07:00
Krrish Dholakia
5aa1c10929 fix(handle_jwt.py): don't require kid to be set 2024-03-25 12:28:16 -07:00
Krrish Dholakia
93959ab5aa fix(handle_jwt.py): allow setting proxy admin role string for jwt auth 2024-03-25 12:20:14 -07:00
Krrish Dholakia
edd00af6f2 fix(handle_jwt.py): enable user to set jwt admin scope string in config 2024-03-25 11:34:49 -07:00
Dragos Campean
4549a20333 Merge remote-tracking branch 'upstream/main' into fix-pip-install-extra-proxy 2024-03-25 20:22:17 +02:00
Ishaan Jaff
734a51c049 (fix) stop using f strings in verbose logger 2024-03-25 10:55:30 -07:00
Krish Dholakia
123e012dc0
Merge pull request #2672 from RoniGurvich/main 
`cryptography` and `python-multipart` version bump
 2024-03-25 10:54:43 -07:00
Krish Dholakia
0804d74d13
Merge pull request #2685 from maxdeichmann/log-langfuse-instantiation 
add langfuse logging
 2024-03-25 10:48:16 -07:00
Ishaan Jaff
5d121a9f3c (fix) stop using f strings with logger 2024-03-25 10:47:18 -07:00
Max Deichmann
efb43ccd02 push 2024-03-25 17:43:55 +01:00
onukura
2df63cc621 Fix ollama embedding response 2024-03-25 16:26:49 +00:00
onukura
ef69eefcdb Fix ollama api_base to enable remote url 2024-03-25 16:26:40 +00:00
Ishaan Jaff
dad4bd58bc (feat) stop eagerly evaluating fstring 2024-03-25 09:01:42 -07:00
Krrish Dholakia
85ee29ade2 bump: version 1.34.0 → 1.34.1 2024-03-25 08:37:01 -07:00
Krrish Dholakia
53695943e3 docs(instructor.md): tutorial on using litellm with instructor 2024-03-25 08:35:11 -07:00
Krrish Dholakia
f98aead602 feat(main.py): support router.chat.completions.create 
allows using router with instructor

https://github.com/BerriAI/litellm/issues/2673
 2024-03-25 08:26:28 -07:00
Krrish Dholakia
9e9de7f6e2 docs(routing.md): add fallbacks being done in order 2024-03-24 12:13:19 -07:00
Roni Gurvich
384882115e cryptography and python-multipart version bump 2024-03-24 08:49:36 +00:00
Roni Gurvich
644632ba3b cryptography and python-multipart version bump 2024-03-24 08:44:36 +00:00
Dragos Campean
4c2274125e Merge remote-tracking branch 'upstream/main' into fix-pip-install-extra-proxy 2024-03-24 08:53:54 +02:00
Dragos Campean
c807a21442 Remove dependency which was removed on main 2024-03-24 08:53:43 +02:00
Krrish Dholakia
63f6a9deff bump: version 1.33.9 → 1.34.0 2024-03-23 22:35:18 -07:00
Krrish Dholakia
1c60fd0e78 docs(routing.md): add url 2024-03-23 20:03:42 -07:00
Krrish Dholakia
7c74ea8b77 docs(routing.md): add proxy example to pre-call checks in routing docs 2024-03-23 20:00:50 -07:00
Krish Dholakia
8f966cd78f
Merge pull request #2666 from BerriAI/litellm_model_fix_v_3 
fix(proxy_server.py): fix model info check
 2024-03-23 19:39:03 -07:00
Ishaan Jaff
92759ef055
Merge pull request #2670 from BerriAI/litellm_docs_best_practices_prod 
(docs) best prod practices
 2024-03-23 19:38:22 -07:00
Krish Dholakia
c92fa1af7c
Merge pull request #2669 from BerriAI/litellm_router_pre_call_checks 
feat(router.py): enable pre-call checks
 2024-03-23 19:38:09 -07:00
Ishaan Jaff
09992a6122 (docs) prod best perf 2024-03-23 19:36:26 -07:00