litellm-mirror/litellm/litellm_core_utils/tokenizers
Ishaan Jaff 3055d9b81c
Code Quality Improvement - remove tokenizers/ from /llms (#7163)
* move tokenizers out of /llms

* use updated tokenizers location

* fix test_google_secret_manager_read_in_memory
2024-12-10 23:50:15 -08:00
..
9b5ad71b2ce5302211f9c61530b329a4922fc6a4 Code Quality Improvement - remove tokenizers/ from /llms (#7163) 2024-12-10 23:50:15 -08:00
__init__.py Code Quality Improvement - remove tokenizers/ from /llms (#7163) 2024-12-10 23:50:15 -08:00
anthropic_tokenizer.json Code Quality Improvement - remove tokenizers/ from /llms (#7163) 2024-12-10 23:50:15 -08:00
ec7223a39ce59f226a68acc30dc1af2788490e15 Code Quality Improvement - remove tokenizers/ from /llms (#7163) 2024-12-10 23:50:15 -08:00
fb374d419588a4632f3f557e76b4b70aebbca790 Code Quality Improvement - remove tokenizers/ from /llms (#7163) 2024-12-10 23:50:15 -08:00