6 commits

Author	SHA1	Message	Date
Ishaan Jaff	b8af46e1a2	(feat) Add usage tracking for streaming /anthropic passthrough routes (#6842) ... * use 1 file for AnthropicPassthroughLoggingHandler * add support for anthropic streaming usage tracking * ci/cd run again * fix - add real streaming for anthropic pass through * remove unused function stream_response * working anthropic streaming logging * fix code quality * fix use 1 file for vertex success handler * use helper for _handle_logging_vertex_collected_chunks * enforce vertex streaming to use sse for streaming * test test_basic_vertex_ai_pass_through_streaming_with_spendlog * fix type hints * add comment * fix linting * add pass through logging unit testing	2024-11-21 19:36:03 -08:00
Ishaan Jaff	fa6b09f147	fix linting error	2024-09-02 18:13:32 -07:00
Ishaan Jaff	f89487a496	fix linting error	2024-09-02 17:08:03 -07:00
Ishaan Jaff	42b95c5979	code cleanup	2024-09-02 16:36:19 -07:00
Ishaan Jaff	a6d4a27207	pass through track usage for streaming endpoints	2024-09-02 16:11:20 -07:00
Ishaan Jaff	fdecafd347	new streaming handler fn	2024-09-02 15:51:21 -07:00