iLdZddlZddlZddlmZddlmZddlmZddl m Z ddl m Z ddl mZdd lmZdd lmZd ed ed efdZdefdZdefdZdefdZdefdZdefdZdefdZdZy)u Function call handlers — wired to the LLM via llm.register_function(). Each handler receives a FunctionCallParams object and uses result_callback to return the result to the LLM context. Handlers also push RTVIServerMessageFrame so the Android client receives structured data (image URLs, video URLs, product cards, search links, etc.) over the WebRTC data channel. The Android app listens for these in VoiceClientManager.handleServerMessage(). N)loggerRTVIServerMessageFrame)FunctionCallParams)generate_image) edit_image) web_search)shopping_search)generate_videomsg_typedatareturnc t||dS)zBuild an RTVI server message frame for the Android client. The RTVIProcessor wraps this into {label: "rtvi-ai", type: "server-message", data: ...} which the Pipecat Android SDK delivers to onServerMessage(). )typer )r r)r r s H/Users/thippareddysaicharanreddy/Desktop/agent_all/functions/handlers.py _rtvi_msgrs "$'G HHparamsc xK|j}|jdg}|jdd}dttjdz}|s|jdr |d|ddzg}t |dkr|dzd d}|d d }t |}|r|d nd }t j d |d|t|D]#\}}t j d|dzd|%|jjtdd||dd {|Dcgc]}t||} }tj| ddid {} g} t| D]h\}} t| tr"t j d|dzd|d| 8| jdsJ| d} | j#|d|| | dj| r|jjtd|| |d t | d!d {t | dkDrd"t | d#nd$}|j%dt | ||d%d&d {y d'}|jjtd(d)|id {|j%d)|d*d {y 7cc}w7[77`707w)+aPHandle generate_image function call from the LLM. Supports generating 2-7 images in parallel with DIFFERENT prompts. Each prompt describes a unique angle/view/style. All Replicate calls run concurrently and successful URLs are sent as an array in a single RTVI message so the Android app can display them together. prompts aspect_ratioz1:1 imgbatch_promptz!, different angle and perspectiveNrz![Handler] generate_image called: z prompts, aspect_ratio=z[Handler] Prompt z: generation_startedimage)generation_type description num_images)rrreturn_exceptionsTz[Handler] Image /z failed: successurl_)image_id image_urls3_urlimage_generation_complete!black-forest-labs/flux-2-klein-4b)batch_idimagesr" image_modelcountzAll z images arez The image isza now visible in the user's app. Do NOT read out any URL. Just tell the user the images are ready.)statusimages_generatedimages_requestedmessagez/All image generations failed. Please try again.generation_endederrorr2r5) argumentsgetinttimelenrinfo enumeratellm push_framerrasynciogather isinstance Exceptionr7appendresult_callback)rargsrrr.r#r"iptasksresultsr/resultr' count_msg error_msgs rhandle_generate_imagerP(s.   Dhhy"%G88NE2L3tyy{T1234H txx)>4>4W#WX 7|aQ;#bqkGWJ ''!*RK KK +J<8$~ ''"1 )!A#b67# **  &&&$)    A al;  NNEBTBBGFw' 6 fi ( LL+AaC5*YvhO P  ::i -C MM'j!-   (jj## 1$ *BV 4    036{Qd3v;-{ + $$#$'K$. k"((   F jj## (7I*> ?   $$!$    A C$    sDJ:J'J:&J*:J:J/AJ:0AJ: J2 AJ:J41J:J6J:!J8"J:*J:2J:4J:6J:8J:c LK|j}|jdd}dttjdz}t j d||j jtdd|dd {|j jtd ||d d {t| d {}|jd rU|d}|j jtd|||dddd {|jd ddd {y |jdd}|j jtd||dd {|jd|dd {y 77777m7,7w)z1Handle generate_video function call from the LLM.rrvideo_rz([Handler] generate_video called: prompt=rvideor!r"Nvideo_generation_started) request_idr)rr&r'video_generation_completezwan-video/wan-2.2-t2v-fast)rV video_urlr video_modeldurationzVideo generated successfully. The video is now visible in the user's app. Do NOT read out any URL. Just tell the user the video is ready.r8r7Video generation failed.video_generation_errorrVr7) r9r:r;r<rr>r@rArr rG)rrHrrVrMrYrOs rhandle_generate_videor_s   D XXh #F#diikD0123J KK:6*EF **  &&!)    **  ,$/   "0 0F zz)5M jj## 1(& ; 4    $$#3   JJw(BC jj## .("1    $$!$    e 1     sBF$F/F$7F8F$ F AF$FF$0F1AF$3F 4F$F"F$F$F$F$F$ F$"F$c K|j}|jdd}tjd||jj t dd|dd{t|d{}|jd r/|jd g}|jd d}|jd |d d d{d} ddl m }||||d{}|jd r5|jdd}tjdt|dn'tjd|jd|jj t d|||dd|dd{|jj t dddid{y|jj t dd|jdddd{|jd|jdddd{y777f7M#t$r#} tjd| Yd} ~ d} ~ wwxYw777p7Fw)uHandle web_search function call from the LLM. Sends the text summary back to the LLM for TTS, and also pushes structured source links + C1 visual card to the Android app via RTVI. C1 visual card generation runs in parallel — it doesn't block the voice response. queryrz#[Handler] web_search called: query=rsearchrTNrar&sourcessummaryzSearch complete. Source links and a visual card are shown in the user's app. Do NOT read out any URLs. Present the information in natural spoken language.)r2search_resultsr5r)generate_visual_card)rarerdc1_dslz$[Handler] C1 visual card generated (z chars)z[Handler] C1 card failed: r7z&[Handler] C1 card generation skipped: rf)rarerdrhr6r!zSearch failed.r!r7r8)r9r:rr>r@rArr rGservices.c1_servicergr=warningrE) rrHrarMrdrerhrg c1_resultes rhandle_web_searchros   D HHWb !E KK5eY?@ **  &' )   E* *F zz)**Y+**Y+$$#")J     I @2WgI}}Y'"x4 B3v;-wWX!;IMM'+    $$!!::g/?@    C+ " I NNCA3G H H I    sA"I.$H+%I.8H.9AI. H1 I.H7'H4(A1H70I. I& .I.8I(9AI.9I*:+I.%I,&I..I.1I.4H77 I#II.I##I.(I.*I.,I.c jK|j}|jdd}tjd||jj t dd|dd{t|d{}|jd r|jd g}|r:|jj t d ||t|d d{|jj t d ddid{|jd |dt|ddd{y|jj t d d|jdddd{|jd|jdddd{y7?7.777|7=7w)zHandle shopping_search function call from the LLM. Sends structured product cards to the Android app via RTVI, and returns a spoken summary to the LLM for TTS. rarz([Handler] shopping_search called: query=rshoppingrTNrcr&productsshopping_results)rarrr1r6r!rezShopping results are now displayed as product cards in the user's app with images, prices, and buy links. Do NOT read out any URLs or links. Just summarize the top products with their names, prices, and store names in natural spoken language.)r2re product_countr5r7zShopping search failed.rjr8) r9r:rr>r@rArr r=rG)rrHrarMrrs rhandle_shopping_searchru4s   D HHWb !E KK:5)DE **  &) )   #/ /F zz)::j"- **''," ( ]/  jj## (+uploaded_imagerGr@rArr) r bot_modulerHrwrr|rzrM edited_urlrOs rhandle_edit_imager}s    Dxx 2B7c$))+,-./G KK/0@/CDE  $ $$$-&     ,,X6L))+6I **  &++)   !$F zz)E] jj## +%"$.$4B .    $$P&    JJw(<= jj## (#/"+    $$ &    s     sBGF2AGF5G(F7)AG1F92G F;AGF=G,F?-G5G7G9G;G=G?Gc Kddl}|j}|jdd}dtt jdz}t j d||js|jdd d d{y|jd }|jd }d |d|}|jjtdd|dd{|jjtd||ddd{t||d{}|jdrV|d} |jjtd|| |ddddd{|jddd d{y|jdd} |jjtd|| dd{|jd| d d{y7h77777p7/7w) zHandle generate_video_from_image function call from the LLM. Takes the user's uploaded photo from memory and sends it directly to Replicate's video model as a base64 data URI. rNrrrRrz,[Handler] generate_video_from_image called: r7zVNo photo uploaded yet. Ask the user to upload a photo first before requesting a video.r8ryrzzdata:z;base64,rrSrTrUr)rVrsource)rr*r&r'rWzlightricks/ltx-2-distilledrX)rVrYrrZr[rzVideo generated from the uploaded photo! The video is now visible in the user's app. Do NOT read out any URL. Just tell the user the video is ready.r\r]r^) rr9r:r;r<rr>rrGr@rArr ) rrrHrrVr|rzdata_urirMrYrOs r handle_generate_video_from_imagersQ    D XXh #F#diikD0123J KK>vjIJ  $ $$$-&     ,,X6L))+6Iyk,8H **  &&!)    **  ,$&/   "8D DF zz)5M jj## 1(& ;* 4   $$9&    JJw(BC jj## .("1    $$ &    C  E    sBG=G+AG=G.0G= G1 G= G3!A G=*G5+G=G7AG= G9 G=%G;&G=.G=1G=3G=5G=7G=9G=;G=cF|jdtd|jdtd|jdtd|jdtd|jdt |jdt tjd y ) zRegister all function handlers with the LLM service. Image and video generation are long-running (10-60s+), so we set cancel_on_interruption=False so the user can keep talking without cancelling the generation. rF)cancel_on_interruptionr rgenerate_video_from_imager r z[Handler] Function handlers registered (generate_image, generate_video, edit_image, generate_video_from_image, web_search, shopping_search)N) register_functionrPr_rrrorurr>)r@s rregister_all_handlersr&s//'#($ ,(9:+-CD KK Br)__doc__rBr<logurur"pipecat.processors.frameworks.rtvirpipecat.services.llm_servicerservices.image_servicerservices.edit_image_servicerservices.search_servicer services.shopping_servicer services.video_servicer strdictrrPr_rorurrrrrrs  E;12.51II4I,BIf (:f X@ (:@ LT $6T tC );C RL $6L dT 3ET nr