Krish Dholakia
|
ca6902e191
|
vertex ai anthropic thinking param support (#8853)
* fix(vertex_llm_base.py): handle credentials passed in as dictionary
* fix(router.py): support vertex credentials as json dict
* test(test_vertex.py): allows easier testing
mock anthropic thinking response for vertex ai
* test(vertex_ai_partner_models/): don't remove "@" from model
breaks anthropic cost calculation
* test: move testing
* fix: fix linting error
* fix: fix linting error
* fix(vertex_ai_partner_models/main.py): split @ for codestral model
* test: fix test
* fix: fix stripping "@" on mistral models
* fix: fix test
* test: fix test
|
2025-02-26 21:37:18 -08:00 |
|
Ishaan Jaff
|
00544b97c8
|
(feat) Add cost tracking for /batches requests OpenAI (#7384)
* add basic logging for create`batch`
* add create_batch as a call type
* add basic dd logging for batches
* basic batch creation logging on DD
* batch endpoints add cost calc
* fix batches_async_logging
* separate folder for batches testing
* new job for batches tests
* test batches logging
* fix validation logic
* add vertex_batch_completions.jsonl
* test test_async_create_batch
* test_async_create_batch
* update tests
* test_completion_with_no_model
* remove dead code
* update load_vertex_ai_credentials
* test_avertex_batch_prediction
* update get async httpx client
* fix get_async_httpx_client
* update test_avertex_batch_prediction
* fix batches testing config.yaml
* add google deps
* fix vertex files handler
|
2024-12-23 17:47:26 -08:00 |
|
Ishaan Jaff
|
62a1cdec47
|
(code quality) run ruff rule to ban unused imports (#7313)
* remove unused imports
* fix AmazonConverseConfig
* fix test
* fix import
* ruff check fixes
* test fixes
* fix testing
* fix imports
|
2024-12-19 12:33:42 -08:00 |
|
Ishaan Jaff
|
e09d3761d8
|
Code Quality Improvement - use vertex_ai/ as folder name for vertexAI (#7166)
* fix rename vertex ai
* run ci/cd again
|
2024-12-11 00:32:41 -08:00 |
|