o wia@sddlZddlZddlZddlmZddlmZmZddlm Z ddl m Z m Z m Z mZddlmZddlmZGdd d eZejGd d d Zed d dgdejdddZedd dgdejdddZeddddgddggdejddZedddgdejd d!d!d" Zed#dd$gdejd%d!d&d" Zed'dd$gdejd%d!d&d" Zed'd(d)gdd*ej d+d*d, Z!ed-d(d.gdd*ej"d/d*d, Z#ed-dd$gdejd-d!d&d" Z$ed0dd$gdejd%d!d&d" Z%ed1dd2gdejd%d!d&d" Z&ed3d4d5gdej'd6d7Z(ed8d9d:gdej)d6d7Z*ed-d;dgdej-d-ddd?Z.eddgdejddZ/ed@dgdejddAdBZ0edddgdejd d!dZ1ed@dgdejd d!dCdDZ2edddEgdej3d-d!d!d" Z4edFd4d5gdej'd6d7Z5edGdHd5gdej'd!d7Z6edId4d5gdej'd6d7Z7edId4d5gdej'd6d7Z8eZ9idJedKededLedMedNe#dOe$dPe5dQe6dRe7dSe4dTe.dUe.dVe8dWe/dXe0dYe1e2ee!e%e&e$e(e*e,eeedZ Z:e;d[kreosz)Conversation.get_prompt..cSs d|dS)Nz[INST] z [/INST]rrErrrrGps z first message should not be nonez#first message should come from userrDzmeta-llama/Llama-2-7b-chat-hf#meta-llama/Meta-Llama-3-8B-Instruct(meta-llama/Llama-3.2-11B-Vision-InstructrCz"mistralai/Mistral-7B-Instruct-v0.2z?Conversation should alternate user/assistant/user/assistant/...zInvalid style: )r"r$r rr r&typetuplerr' enumeraterr)r!rr*r=rrrrrlenrr ValueError) r/r"r<r1r;_sepsiwrap_sys wrap_instr*imagesrrr get_promptNs              i  ^ O  K  A   6  /        zConversation.get_promptcCs|j||gdSr.)r"r6)r/r1r;rrrappend_messageszConversation.append_messagePNGcCs|dkrd dd}||}n|dvrn|dkr|d}ntd|t|tjur3t|d }t|jt|j}}||}d \} } t t| || |} t | |} |j\} }|| kre| | }} n| | }} || |f}|ru|St }|j ||d t |}|S) NPadzthcSs~|j\}}||kr |S||kr't|j||f|}||d||df|St|j||f|}||||ddf|S)Nrr?)sizer newmodepaste)pil_imgbackground_colorwidthheightresultrrr expand2squares z1Conversation.process_image..expand2square)DefaultCropResize)PrlzInvalid image_process_mode: RGB)ii)format)r[)resizerPrLr openconvertmaxr_minintrsavebase64 b64encodegetvaluedecode)r/imageimage_process_mode return_pil image_formatrhmax_hwmin_hw aspect_ratiomax_lenmin_len shortest_edge longest_edgeWHbuffered img_b64_strrrr process_images4       zConversation.process_imagec Csg}t|j|jdD]4\}\}}|ddkr@t|tur@|\}}}t|tkr,|g}|D]} |s:|j| ||d} || q.q |S)Nr?r)r|)rNr"r#rLrMlistrr6) r/r| return_pathrVrSr1rFrzr{imgrrr get_imagess      zConversation.get_imagesc Csg}t|j|jdD]q\}\}}|ddkrwt|turo|\}}}t|tkr,|g}t|dkr=d|dd}nt dd|}|D]}|j |d d d d }d |d} |d| d}qFt|dkrn| |dgq | |dgq ||dd<q |S)Nr?rrAz rKrDz()\n(?=)z\1 riFJPEG)r|r}z!) rNr"r#rLrMrrOreplacestripresubrr6) r/r<rSr1rFrzr{rrimg_strrrrto_gradio_chatbot,s(        zConversation.to_gradio_chatbotc Cs2t|j|jdd|jD|j|j|j|j|jdS)NcSsg|]\}}||gqSrr.0xyrrr Hsz%Conversation.copy..r r!r"r#r$r&r'r)) rr r!r"r#r$r&r'r)r/rrrcopyDszConversation.copycCsVt|dkr|j|jdd|jD|j|j|jdS|j|j|j|j|j|jdS)NrcSs,g|]\}}|t|tur|dn|gqS)r)rLrMrrrrrUs,z%Conversation.dict..)r r!r"r#r&r')rOrr r!r"r#r&r'rrrrdictPs zConversation.dict)FrY)FF) r rrrrstr__annotations__rMrrtr rr$r&r'r)r*rr+r r,r-boolr0r=rWrXrrrrrrrrrr,s0          . rzA chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions. )User Assistantnvgptz zSystem )r r!r)r"r#r$r&r'rCnv_dpozA chat between a curious human and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the human's questions.)HumanrrzPWhat are the key differences between renewable and non-renewable energy sources?ragRenewable energy sources are those that can be replenished naturally in a relatively short amount of time, such as solar, wind, hydro, geothermal, and biomass. Non-renewable energy sources, on the other hand, are finite and will eventually be depleted, such as coal, oil, and natural gas. Here are some key differences between renewable and non-renewable energy sources: 1. Availability: Renewable energy sources are virtually inexhaustible, while non-renewable energy sources are finite and will eventually run out. 2. Environmental impact: Renewable energy sources have a much lower environmental impact than non-renewable sources, which can lead to air and water pollution, greenhouse gas emissions, and other negative effects. 3. Cost: Renewable energy sources can be more expensive to initially set up, but they typically have lower operational costs than non-renewable sources. 4. Reliability: Renewable energy sources are often more reliable and can be used in more remote locations than non-renewable sources. 5. Flexibility: Renewable energy sources are often more flexible and can be adapted to different situations and needs, while non-renewable sources are more rigid and inflexible. 6. Sustainability: Renewable energy sources are more sustainable over the long term, while non-renewable sources are not, and their depletion can lead to economic and social instability. r?r%)r r!r"r#r$r&zA chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions.)USER ASSISTANTv1r@z) r r!r)r"r#r$r&r'r+aYou are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.llama_v2rHz zYou are a helpful language and vision assistant. You are able to understand the visual content that the user provides, and assist the user with a variety of tasks using natural language.)user assistantllama_v3z <|eot_id|>rI) r r!r)r"r#r&r$r*r+rD llama_v3_2rJzEAnswer the questions about the visual content that the user provides.zAnswer the questions about the visual content that the user provides.The visual content will be provided with the following format: visual content.llama_v2_mmtagz<|im_start|>system A conversation between a user and an LLM-based AI assistant. The assistant gives helpful and honest answers.)z<|im_start|>user z<|im_start|>assistant mptz <|im_end|>)r r!r)r"r#r$r&z/<|im_start|>system You are a helpful assistant.)z<|im_start|>userz<|im_start|>assistantqwen)zuser zmodel gemmaz )rDrD)r r!r"r#r$r&r'r+a7A chat between a curious user and an artificial intelligence assistant. The assistant is able to understand the visual content that the user provides, and assist the user with a variety of tasks using natural language.The visual content will be provided with the following format: visual content.v0_mmtag)r r!r"r#r$r&r)v1_mmtagrrBz<|im_start|>system You are MistralOrca, a large language model trained by Alignment Lab AI. Write out your reasoning step-by-step to be sure you get the right answers!z*<|system|> You are a helpful AI assistant.)z <|user|> z<|assistant|> z(<|im_start|>system Answer the questions.defaultv0 vicuna_v1llama_2mllamamistral_instruct mistral_orcamistral_zephyrmistral_directmistralplainv0_plain chatml_directllava_v0llava_v0_mmtagllava_v1) llava_v1_mmtag llava_llama_2 llava_llama_3llava_llama_2_simplellava_llama_2_mmtagllava_mistral_instructrqwen_1_5gemma_instructr nv_steerlmr__main__)>rv dataclassesr collectionsrenumrriortypingrrrr PILr transformersr r dataclassrr conv_nvgpt conv_nv_dporconv_vicuna_v0rconv_vicuna_v1r conv_llama_2conv_llava_llama_2rconv_llava_llama_3r conv_mllamaconv_mistral_instructconv_llava_llama_2_simpleconv_llava_llama_2_mmtagrconv_mptr conv_qwenrconv_gemma_instructrconv_llava_plain conv_llava_v0conv_llava_v0_mmtag conv_llava_v1conv_llava_v1_mmtagrconv_mistral_vilaconv_mistral_orcaconv_mistral_zephyrconv_mistral_directconv_chatml_directdefault_conversationconv_templatesr printrWrrrrsf    :  !