o پi"@s$ddlZddlZddlZddlmZmZmZmZddlZddl m Z ddl m Z m Z ddlmZddlmZddlmZddlmZdd lmZdd lmZdd lmZmZer^dd lmZeeefZGd ddeZGdddeZddZ GdddeZe!dddgZ"GdddeZ#dS)N) TYPE_CHECKINGAny GeneratorUnion) DedentError)UnexpectedCharactersUnexpectedToken)Generate)Guide) RegexGuide)Write)create_states_mapping)grammars) PartialLarkPartialParserState) Tokenizerc@seZdZUdZeed<dS)r akBase definition of a generation guide. A generation guide defines the behavior of a finite-state machine that guides a text generation procedure. Unlike the DFAs built from regular expressions guides can also emit a `Write` instructions which tells the model that it can append a sequence of tokens (or token word) instead of generating it. initial_stateN)__name__ __module__ __qualname____doc__r__annotations__rrF/home/ubuntu/.local/lib/python3.10/site-packages/outlines/fsm/guide.pyr s  r c@sdeZdZdZdZdZdZdddZded e fd d Z ded ed efd dZ defddZ ddZ dS)StopAtEOSGuidez@Guide to generate tokens until the EOS token has been generated.r tokenizerrcCs|j|_|j|_dS)zzInitialize the generation guide. model The logit generator used to generate the next token. N) eos_token_id vocabularyvalues)selfrrrr__init__/szStopAtEOSGuide.__init__statereturncCs||r t|jgStdSN)is_final_stater rr r r"rrrget_next_instruction9s  z#StopAtEOSGuide.get_next_instructiontoken_idcCs ||jks ||jkr |jS|jSr$)r final_stater)r r"r(rrrget_next_state>szStopAtEOSGuide.get_next_statecCs ||jkSr$)r)r&rrrr%Ds zStopAtEOSGuide.is_final_statecCs|Sr$rr rrrcopyGszStopAtEOSGuide.copyN)rr)rrrrr) start_staterr!int Instructionr'r*r%r,rrrrr(s   rcOst||g|Ri|Sr$)uncached_create_states_mapping) regex_stringrargskwargsrrrcached_create_states_mappingKsr4cs*eZdZdZedeffdd ZZS)r zp Guide to generate text in the language of a regular expression. CoreRegexGuide with outlines cache r1c stj||fdti|S)N_create_states_mapping)super from_regexr4)clsr1rr3 __class__rrr7UszRegexGuide.from_regex)rrrr classmethodstrr7 __classcell__rrr9rr Os r CFGState parser_state prev_tokenc @seZdZdZdefddZdedefddZded e de e d d ffd d Z ded e defddZ ded e defddZdedefddZdedefddZdedefddZdddZd S)CFGGuidezNGuide to generate text that is in the language of a context-free Lark grammar. cfg_stringcCsNtd||_||_|jj|_t|dtjgd|_t |j ddd|_ dS)zg Construct the PartialLark parser and set the empty initial_state (PartialParserState) zOutlines' public *community-contributed* CFG structured generation is experimental. Please review https://dottxt-ai.github.io/outlines/latest/reference/generation/cfg#disclaimerlalr)parser import_pathsNr?r@) warningswarnrBrrrr GRAMMAR_PATHrDr>parser)r rBrrrrr!js   zCFGGuide.__init__r"r#cCs\|jdurtt|jgSt|||jj }t |dkr'tt|St t|S)aWReturn the next instruction for guided generation. Current lazy approach: - For each token in the vocabulary - create a copy of the parsers state - add the tokens to the parsers input text - if valid, add token to returned tokens Further refinements are necessary for performant text processing. Parameters ---------- state The guides current PartialParserState, or None if complete Returns ------- A `Generate` instance that contains the model and the allowed token ids. Nr) r?r torchtensorrlistiter_valid_token_idsrrrlenr )r r" valid_tokensrrrr's  zCFGGuide.get_next_instructioncandidate_token_idsNc csx|jdur |jVdS|D]+}||jkr||r|Vqz ||t||VWqttttt fy9YqwdS)a Iterate over the given token_ids and yield those that are valid for the current parser state. Parameters ---------- parser_state The current state of the parser, or None if complete. token_ids The list of token ids to check for validity. Yields ------ int Valid token ids. N) r?rcan_terminate_state_get_parser_state_token_appliedr. ValueErrorEOFErrorrrr)r r"rRr(rrrrOs,     zCFGGuide.iter_valid_token_idsr(cCs6|jdus ||jkr d}n||t|}t||dS)a Update the state of the guide. Decode the token_id, and calculate the new parser_state with the token applied. Parameters ---------- state The guides current PartialParserState, or None if complete token_id The id of the token that was just generated. Returns ------- The guides new PartialParserState NrG)r?rrTr.r>)r r"r(r?rrrr*s zCFGGuide.get_next_statecCst|j}|jdur|j|gd}n|j|jggd}|j|j|ggd}|t|d}|dkrr/r'rNrr.rOr*rrTboolr%rSrcr,rrrrrAgs.   ' ! rA)$ collectionsr,rHtypingrrrrrL lark.indenterr lark.lexerrroutlines_core.fsm.guider r CoreGuider CoreRegexGuider r r0outlinesroutlines.fsm.parsingrroutlines.models.tokenizerrr/rr4 namedtupler>rArrrrs.          #