o »Ù·iÝã @s¨UddlmZddlmZddlmZidd“dd“dd“d d“d d“d d“d d“d d“dd“dd“dd“dd“dd“dd“dd“dd“dd“Zded<idd“dd“dd“dd“dd“d d“d!d“d"d“d#d“d$d“d%d“d&d“d'd“d(d“d)d“d*d+“d,d+“id-d.“d/d.“d0d.“d1d.“d2d.“d3d.“d4d.“d5d.“d6d+“d7d+“d8d+“d9d+“d:d+“d;d+“dd=“d?d.“¥d.d.d.d.d.d.d.d.d.d@d@dAœ ¥ZdedB<dLdFdG„Z dMdIdJ„Z dKS)Né)Ú annotationsé)ÚEncoding)Ú get_encodingzo1-Ú o200k_basezo3-zo4-mini-zgpt-5-zgpt-4.5-zgpt-4.1-z chatgpt-4o-zgpt-4o-zgpt-4-Ú cl100k_basezgpt-3.5-turbo-z gpt-35-turbo-zgpt-oss-Ú o200k_harmonyz ft:gpt-4ozft:gpt-4zft:gpt-3.5-turbozft:davinci-002zft:babbage-002zdict[str, str]ÚMODEL_PREFIX_TO_ENCODINGÚo1Úo3zo4-minizgpt-5zgpt-4.1zgpt-4ozgpt-4z gpt-3.5-turbozgpt-3.5z gpt-35-turboz davinci-002z babbage-002ztext-embedding-ada-002ztext-embedding-3-smallztext-embedding-3-largeztext-davinci-003Ú p50k_baseztext-davinci-002ztext-davinci-001Ú r50k_baseztext-curie-001ztext-babbage-001z text-ada-001ÚdavinciÚcurieÚbabbageÚadazcode-davinci-002zcode-davinci-001zcode-cushman-002zcode-cushman-001z davinci-codexz cushman-codexztext-davinci-edit-001Ú p50k_editzcode-davinci-edit-001ztext-similarity-davinci-001Úgpt2) ztext-similarity-curie-001ztext-similarity-babbage-001ztext-similarity-ada-001ztext-search-davinci-doc-001ztext-search-curie-doc-001ztext-search-babbage-doc-001ztext-search-ada-doc-001zcode-search-babbage-code-001zcode-search-ada-code-001rzgpt-2ÚMODEL_TO_ENCODINGÚ model_nameÚstrÚreturncCsXd}|tvr t|}nt ¡D] \}}| |¡r|Sq|dur*td|›dƒd‚|S)zrReturns the name of the encoding used by a model. Raises a KeyError if the model name is not recognised. NzCould not automatically map z_ to a tokeniser. Please use `tiktoken.get_encoding` to explicitly get the tokeniser you expect.)rr ÚitemsÚ startswithÚKeyError)rÚ encoding_nameÚ model_prefixÚmodel_encoding_name©rúB/home/ubuntu/.local/lib/python3.10/site-packages/tiktoken/model.pyÚencoding_name_for_modelXs  ÿ ÿýr rcCs tt|ƒƒS)zfReturns the encoding used by a model. Raises a KeyError if the model name is not recognised. )rr )rrrrÚencoding_for_modelqs r!N)rrrr)rrrr) Ú __future__rÚcorerÚregistryrr Ú__annotations__rr r!rrrrÚsò  ÿþýûúùø ÷ ö õ ô óñðïî íþýüúùø ÷ ö õ ôòñïîíêéèçæåäãâá!ß"Þ#Ý$Ü%Û&Ú(Ø)×+Õ,É ;