o niO @szdZddlZddlmZddlmZmZmZddlm Z m Z m Z ddgZ GdddeZ iZed ZGd ddeZdS) z pygments.lexers.special ~~~~~~~~~~~~~~~~~~~~~~~ Special lexers. :copyright: Copyright 2006-2017 by the Pygments team, see AUTHORS. :license: BSD, see LICENSE for details. N)Lexer)TokenErrorText)get_choice_opt text_typeBytesIO TextLexer RawTokenLexerc@s:eZdZdZdZdgZdgZdgZdZddZ d d Z d S) r z3 "Null" lexer, doesn't highlight anything. z Text onlytextz*.txtz text/plaing{Gz?ccsdt|fVdS)Nr)r)selfr r b/home/ubuntu/SoloSpeech/.venv/lib/python3.10/site-packages/wandb/vendor/pygments/lexers/special.pyget_tokens_unprocessed sz TextLexer.get_tokens_unprocessedcCstjS)N)r priority)r r r r analyse_text#szTextLexer.analyse_textN) __name__ __module__ __qualname____doc__namealiases filenames mimetypesrrrr r r rr s s.*? c@s<eZdZdZdZdgZgZdgZddZddZ d d Z d S) r aq Recreate a token stream formatted with the `RawTokenFormatter`. This lexer raises exceptions during parsing if the token stream in the file is malformed. Additional options accepted: `compress` If set to ``"gz"`` or ``"bz2"``, decompress the token stream with the given compression algorithm before lexing (default: ``""``). zRaw token datarawzapplication/x-pygments-tokenscKs*t|dgdd|_tj|fi|dS)Ncompress)nonegzbz2r)rrr__init__)r optionsr r rr <szRawTokenLexer.__init__ccst|tr |d}|jdkr#ddl}|dddt|}|}n|jdkr1ddl}| |}| dd}| |D] \}}}||fVq=dS) Nasciirrrrb r ) isinstancerencodergzipGzipFilerreadr decompressstripr)r r r(gzipfileritvr r r get_tokensAs       zRawTokenLexer.get_tokensc csd}t|D]c}z |dd\}}Wnty)|dd}t}Yn6wt|}|sVt }|ddd}|D]}|rH|d sLtdt ||}q>|t|<|dd d }|||fV|t |7}qdS) Nr r"replace.zmalformed token namezunicode-escape) line_refinditergroupsplit ValueErrordecoder _ttype_cachegetrisuppergetattrlen) r r lengthmatchttypestrvalttypettypesttype_r r rrSs,    z$RawTokenLexer.get_tokens_unprocessedN) rrrrrrrrr r1rr r r rr +s  )rrepygments.lexerrpygments.tokenrrr pygments.utilrrr__all__r r>compiler8r r r r rs