Krrish Dholakia b756374a4f feat(utils.py): bump tiktoken dependency to 0.7.0 ... adds support for gpt-4o token counting		2024-06-10 21:21:23 -07:00
..
9b5ad71b2ce5302211f9c61530b329a4922fc6a4	fix(utils.py): use local tiktoken copy	2023-12-28 11:22:33 +05:30
__init__.py	refactor(__init__.py): adds init.py file in tokenizers	2024-01-22 15:33:16 -08:00
anthropic_tokenizer.json	adding support for cohere, anthropic, llama2 tokenizers	2023-09-22 14:03:52 -07:00
ec7223a39ce59f226a68acc30dc1af2788490e15	fix(openai.py): return logprobs for text completion calls	2024-04-02 14:05:56 -07:00
fb374d419588a4632f3f557e76b4b70aebbca790	feat(utils.py): bump tiktoken dependency to 0.7.0	2024-06-10 21:21:23 -07:00