3 commits

Author	SHA1	Message	Date
Krish Dholakia	f2a7edaddc	fix(proxy_server.py): Fix "Circular reference detected" error when max_parallel_requests = 0 (#9671) ... * fix(proxy_server.py): remove non-functional parent backoff/retry on /chat/completion Causes circular reference error * fix(http_parsing_utils.py): safely return parsed body - don't allow mutation of cached request body by client functions Root cause fix for circular reference error * Revert "fix: Anthropic prompt caching on GCP Vertex AI (#9605)" (#9670) This reverts commit a8673246dc. * add type hints for AnthropicMessagesResponse * define types for response form AnthropicMessagesResponse * fix response typing * allow using litellm.messages.acreate and litellm.messages.create * fix anthropic_messages implementation * add clear type hints to litellm.messages.create functions * fix anthropic_messages * working anthropic API tests * fixes - anthropic messages interface * use new anthropic interface * fix code quality check * docs anthropic messages endpoint * add namespace_packages = True to mypy * fix mypy lint errors * docs anthropic messages interface * test: fix unit test * test(test_http_parsing_utils.py): update tests --------- Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>	2025-03-31 22:06:02 -07:00
Ishaan Jaff	fbace8d041	unit test reset budget job	2025-03-17 19:54:51 -07:00
Ishaan Jaff	c0aec0cc5d	(Bug fix) - reading /parsing request body when on hypercorn (#8734) ... * _safe_get_request_parsed_body * use scope on hypercorn * test http parsing utils * ci/cd run again	2025-02-25 15:18:04 -08:00