o پi@sddlmZddlmZmZddlmZmZmZddl m Z m Z ee fde de defdd Z e ee fde de fd d Ze ee fde de fd d Ze ee fde de fddZdS))singledispatch)SequenceGeneratorAdapterVisionSequenceGeneratorAdapter)LlamaCppOpenAITransformersVision)Sampler multinomialcfg_strsamplerreturncC&ddlm}|||jd}t|||S)aRGenerate text in the language of a Context-Free Grammar Arguments --------- model: An `outlines.model` instance. sampler: The sampling algorithm to use to generate token ids from the logits distribution. Returns ------- A `SequenceGeneratorAdapter` instance that generates text. rCFGLogitsProcessor tokenizer)outlines.processorsrrrmodelr r rlogits_processorrI/home/ubuntu/.local/lib/python3.10/site-packages/outlines/generate/cfg.pycfg s  rcCr )Nrrr)rrrrrrrr cfg_vision$s  rcCtd)Nz3Not yet available due to bug in llama_cpp tokenizerNotImplementedErrorrr r rrr cfg_llamacpp,srcCr)NzfCannot use grammar-structured generation with an OpenAI modeldue to the limitations of the OpenAI API.rrrrr cfg_openai1srN) functoolsroutlines.generate.apirroutlines.modelsrrroutlines.samplersrr strrregisterrrrrrrrs&