o ۾i|@s(dZddlmZmZddlZddlZddlmZmZddl m Z m Z m Z ddlm Z mZddlmZeeZdd Zd d Zed d ZddZddZddZddZddZddZddZddZddZd d!Zd"d#Z d$d%Z!d&d'Z"d(d)Z#d*d+Z$d,d-Z%d.e&fd/d0Z'dd1d2d3Z(dS)4z& Implement transformation on Numba IR ) namedtuple defaultdictN)compute_cfg_from_blocksfind_top_level_loops)errorsirir_utils)compute_use_defsr) PYVERSIONcsfdd}dd}fdd}tdg}tD]&}td|||rA||rA||rA|jvrA||td |q|S) zE Returns a list of loops that are candidate for loop lifting csdt}|jD]}tdd|D}|stddS||O}qt|dk}td|||S)z)all exits must point to the same locationcss|]\}}|VqdSN).0x_r r I/home/ubuntu/.local/lib/python3.10/site-packages/numba/core/transforms.py szL_extract_loop_lifting_candidates..same_exit_point..zreturn-statement in loop.Fzsame_exit_point=%s (%s))setexits successors_loggerdebuglen)loopoutedgesksuccsok)cfgr rsame_exit_points    z9_extract_loop_lifting_candidates..same_exit_pointcSst|jdk}td||S)zthere is one entryrz one_entry=%s)rentriesrr)rrr r r one_entry(s z3_extract_loop_lifting_candidates..one_entrycsvt|jt|jBt|jB}tj|D]}|jD]}t|tjr2t|j tj r2t ddSqqt ddS)z!cannot have yield inside the loopz has yieldFzno yieldT) rbodyr rmap __getitem__ isinstancerAssignvalueYieldrr)rinsidersblkinstblocksr r cannot_yield.s    z6_extract_loop_lifting_candidates..cannot_yieldzfinding looplift candidatesztop-level loop: %szadd candidate: %s)rinforr entry_pointr append)rr-rr!r. candidatesrr )r-rr _extract_loop_lifting_candidatess       r3cCs||}||}i}|D]}||||<q t} t} t|} | jD]} | | O} q$| jD]} | | O} q0| | B} tt|| @}tt|| @| @}||fS)z7Find input and output variables to a block region. )rr usemapvaluesdefmapsorted)r-livemapcallfromreturntobody_block_idsinputsoutputs loopblocksr used_varsdef_varsdefsvsused_or_definedr r rfind_region_inout_varsHs   rDloop_lift_infoz%loop,inputs,outputs,callfrom,returntocCst||}g}|D]G}|j\}tt|j}t|jdkr&||\\}} n|}t|jt|jBt|jB} t ||||| d\} } t || | ||d} | | q |S)z8 Returns information on looplifting candidates. r)r-r8r9r:r;)rr<r=r9r:) r3r nextiterrrrrr"rD_loop_lift_infor1)rr-r8loops loopinfosrr9an_exitr:rlocal_block_idsr<r=llir r r_loop_lift_get_candidate_infoshs*   rNcCs2|j}|j}tj||d}tj|||||d|S)zR Transform calling block from top-level function to call the lifted loop. scopeloc)newblockcallee label_nextr<r=)rPrQrBlockrfill_block_with_call) liftedloopblockr<r=r:rPrQr*r r r_loop_lift_modify_call_blocksrYcCsh||j}|j}|j}t|d}tjtj||d|j|jd||<tj tj||d|j d||j <dS)z? Inplace transform loop blocks for use as lifted loop. rrO)rXr<rT)rXr=N) r9rPrQminrfill_callee_prologuerrUr<fill_callee_epiloguer=r:)loopinfor- entry_blockrPrQfirstblkr r r_loop_lift_prepare_loop_funcs     r`csddlm}|j}t|jt|jB} t|jdkr| |jO} tfdd| D} t || g} | D] } | | j ddq5t | dd d } | j}|j| t|jt|jd |d }||||||}t||j|j|j|j}| D]}|=qt||j<|S) zu Modify the block inplace to call to the lifted-loop. Returns a dictionary of blocks of the lifted-loop. r) LiftedLooprc3s |] }||fVqdSr )copy)r rr,r rrsz+_loop_lift_modify_blocks..getiter)opcSs|jjSr )rQline)rr r rsz*_loop_lift_modify_blocks..)keyT)r- arg_names arg_countforce_non_generatorrQ)numba.core.dispatcherrarrr"r rrdictr`r5extend find_exprsrZrQderivetupler<rYr9r=r:)func_irr]r- typingctx targetctxflagslocalsrar loopblockkeysr> getiter_exprsr* first_getiterloop_loc lifted_irrW callblockrr r,r_loop_lift_modify_blockss:      r|cCsrt|jdkr dSt|j}|}t}t|}|r3|}||||||h8}||}|st|dkS)zReturns True if there is more than one exit in the loop. NOTE: "common exits" refers to the situation where a loop exit has another loop exit as its successor. In that case, we do not need to alter it. rF)rrrpost_dominatorspopadd)rlpinforpdom processedremainnoder r r_has_multiple_loop_exitss   rcCsZddlm}t|j}|D]}t||r t||j\}}q| || |S)z(Canonicalize loops for looplifting. r) PostProcessor) numba.core.postprocrrr-rIr5r_fix_multi_exit_blocksr_reset_analysis_variablesrun)rqrr loop_info _common_keyr r r_pre_looplift_transforms    rc Cst|}|j}t|}t|||jj}g}|r$tdt || |D]} t || |||||} | | q&|j |d} | |fS)z Loop lifting transformation. Given a interpreter `func_ir` returns a 2 tuple of `(toplevel_interp, [loop0_interp, loop1_interp, ....])` z+loop lifting this IR with %d candidates: %sr,)rr-rbrrNvariable_lifetimer8rrrdump_to_stringr|r1ro) rqrrrsrtrur-rrJrIr]liftedmainr r r loop_liftings$    rcsftfddfddfdd}ddfd d }|D]}||q*S) z5 Rewrite loops that have multiple backedges. cstdS)Nr)maxkeysr ) newblocksr r new_block_id*z6canonicalize_cfg_single_backedge..new_block_idcsFd}|jD]}|}|j}|j|vr |d7}|dkr dSqdS)NrrTF)r" terminator get_targetsheader)rcountrr*edgesr,r rhas_multiple_backedges-s   z@canonicalize_cfg_single_backedge..has_multiple_backedgesc3s&D] }|r|VqdSr )rIr5)lp)rrr r#yield_loops_with_multiple_backedges:s zMcanonicalize_cfg_single_backedge..yield_loops_with_multiple_backedgescsnfdd}t|tjrtj|j||j||j|jdSt|tjr/tj||j|jdS| r5J|S)Ncs|krS|Sr r )targetdstsrcr rreplace@rzIcanonicalize_cfg_single_backedge..replace_target..replace)condtruebrfalsebrrQrrQ) r%rBranchrrrrQJumprr)termrrrr rrreplace_target?s   z8canonicalize_cfg_single_backedge..replace_targetcs|j}}|jD]}|}||jvr(|}|j|||jd<||<q |}tj|j|jd}| tj ||jd||<dS)zC Add new tail block that gathers all the backedges rOrN) rr"rrrbrrUrPrQr1r)rrtailkeyblkkeyr*newblkentryblktailblk)rrrr rrewrite_single_backedgeNs   zAcanonicalize_cfg_single_backedge..rewrite_single_backedge)rrb)r-rrrr )r-rrrrrr canonicalize_cfg_single_backedge#s     rcCst|S)zc Rewrite the given blocks to canonicalize the CFG. Returns a new dictionary of blocks. )rr,r r rcanonicalize_cfgisrc sddlm}dfdd }t|\}}|s|gfS|||js(J|j}|j} |j} g} |D]2\} } g}t | | | D]}| |qCt | | t || | \}}| || | | |||}| |q7| sr|}|| fS|| }|| fS)zWith-lifting transformation Rewrite the IR to extract all withs. Only the top-level withs are extracted. Returns the (the_new_ir, the_lifted_with_ir) r)postprocFcsVddlm}m}}|rd|_d|_d|_d|_|}n|}|||fi|S)Nr) LiftedWithObjModeLiftedWithFT)rkrrrbenable_loopliftenable_pyobjectforce_pyobjectno_cpython_wrapper)rq objectmodekwargsrrmyflagsclsrtrursrrr rdispatcher_factoryzsz(with_lifting..dispatcher_factoryN)F) numba.corerfind_setupwithsrrrr-rbr_cfg_nodes_in_regionr1_legalize_with_head_get_with_contextmanagermutate_with_bodyro)rqrrrsrtrurrwithsvltr-rsub_irs blk_startblk_end body_blocksrcmkindextrasubnew_irr rr with_liftingqs6          rcsdfddfdd}jD]&}t|tjr=|j}||\}}t|ds7tjdjd||fSqtjd jd) z7Get the global object used for the context manager zIllegal use of context-manager.cs |S)z#Get the definition given a variable)get_definition)varrqr r get_var_dfns z-_get_with_contextmanager..get_var_dfncs|}t|tjr-|jdkr-fdd|jD}fdd|jD}||d}|j}nd}t tj |}|tj urFt j djd |durRt j |jd ||fS) zReturn the context-manager object and extra info. The extra contains the arguments if the context-manager is used as a call. callcsg|]}|qSr r )r rrr r szD_get_with_contextmanager..get_ctxmgr_obj..csi|] \}}||qSr r )r rvrr r szD_get_with_contextmanager..get_ctxmgr_obj..)argsrNz*Undefined variable used as context managerrQ)rr%rExprrdrkwsfuncrguardfind_outer_value UNDEFINEDr CompilerErrorrQ)var_refdfnrrrctxobj_illegal_cm_msgrr-rqrr rget_ctxmgr_objs   z0_get_with_contextmanager..get_ctxmgr_objrz"Unsupported context manager in userzmalformed with-context usage) r"r%r EnterWithcontextmanagerhasattrrrrQ)rqr-rrstmtrrrr rrrs$      rcCstt}|jD] }|t|d7<q|tjdkr$tjd|j d|tj ddkr5tjd|j d|tj d|rFtjd|j ddS)zaGiven *blk*, the head block of the with-context, check that it doesn't do anything else. rz0with's head-block must have exactly 1 ENTER_WITHrrz*with's head-block must have exactly 1 JUMPNz'illegal statements in with's head-block) rintr"typer~rrrrrQrDel)r*countersrr r rrs( rc sht|g}|r2|}t||}|r0t|\}}tfdd|D}|||O|sS)z;Find the set of CFG nodes that are in the given region cs g|] }|vr|kr|qSr r )r r region_end region_nodesr rr s z(_cfg_nodes_in_region..)rr~listrziprm) r region_beginrstacktossucclistrrnodesr rrrs   rc sdd}j}||}t||dd|D}|D]\}}||j}t|dkr2tdq|D]\}}||}t j|jdjrPt |q5fdd|D}t |}|fS) zQFind all top-level with. Returns a list of ranges for the with-regions. c Ss&t|}tt}}|D]\}}|jD]}t|r"||t|r,||qqtt}|j |ddD]W}gg} } | || r| }| |||jD]8}t |rat dt|rx||vrx|||||nt|r|D] } | | vr| | qqU| sGq9|S)NT)reversezBunsupported control flow due to raise statements inside with block)rritemsr"r is_setup_withr is_pop_blockr topo_sortr1r~is_raiserrremove is_terminatorr) r-r sus_setupssus_popslabelrXrsetup_with_to_pop_blocks_map setup_blockto_visitseentr r r find_rangessD             z$find_setupwiths..find_rangescSs g|] \}}|t|dfqSr)rr spr r rrUsz#find_setupwiths..rzlunsupported control flow: with-context contains branches (i.e. break/return/raise) that can leave the block rcs(g|]\}}|j|jdfqSr)r-rrrrr rris) r-consolidate_multi_exit_withsrrrrrrr is_return_rewrite_return_eliminate_nested_withs) rqrr-with_ranges_dictwith_ranges_tuplerrtargets target_blockr rrrs82       rcCsx|j|}|jd}|j|}t|j}|d}|j}tjd|d}tj||d} gg} } g| tj } t | dksAJt g| tj dksOJt |jdtj sZJ| d} |j| }| |jd|| t ||j| |j|d| t ||j|j|j}| j||j|j| |j|j| | |j|<t|j|_|S)u:Rewrite a return block inside a with statement. Arguments --------- func_ir: Function IR the CFG to transform target_block_label: int the block index/label of the block containing the POP_BLOCK statement This implements a CFG transformation to insert a block between two other blocks. The input situation is: ┌───────────────┐ │ top │ │ POP_BLOCK │ │ bottom │ └───────┬───────┘ │ ┌───────▼───────┐ │ │ │ RETURN │ │ │ └───────────────┘ If such a pattern is detected in IR, it means there is a `return` statement within a `with` context. The basic idea is to rewrite the CFG as follows: ┌───────────────┐ │ top │ │ POP_BLOCK │ │ │ └───────┬───────┘ │ ┌───────▼───────┐ │ │ │ bottom │ │ │ └───────┬───────┘ │ ┌───────▼───────┐ │ │ │ RETURN │ │ │ └───────────────┘ We split the block that contains the `POP_BLOCK` statement into two blocks. Everything from the beginning of the block up to and including the `POP_BLOCK` statement is considered the 'top' and everything below is considered 'bottom'. Finally the jump statements are re-wired to make sure the CFG remains valid. rrNrr)r-rrrfind_max_labelrQrScoperU find_instsPopBlockrrr%r"indexrmr1clearbuild_definitions _definitions)rqtarget_block_labelrtarget_block_successor_labeltarget_block_successor max_label new_label new_block_locnew_block_scope new_blocktop_body bottom_body pop_blocks pb_markerpb_is return_bodyr r rrrs8 :           rcCs<g}dd}t|D]\}}||||s|||fq |S)NcSs(|D]\}}||kr||krdSqdS)NTFr )startend known_rangesabr r rwithin_known_ranges z3_eliminate_nested_withs..within_known_range)r7r1) with_rangesr3r6rer r rrs rrcCs@|D]}||}t|dkrt||tjd\}}|h||<q|S)zGModify the FunctionIR to merge the exit blocks of with constructs. rsplit_condition)rrrr)rr-rqrrBcommonr r rrs  rr9c Cs|j}t|j}|j}t|jd}tj|jtjd}|}|d7}|||<tj|jtjd} |} |d7}| || <g} t|D]_\} } || }|dur]t|j D] \}}||r[nqQnd}|j d|}|j |d}| |||_ |j }|j tj tj | |d|jd|d|d|jrJ|j tj|tjdq@|dur|j | dd|jrJ|j tj| |dg}| D] }| ||d7}q| }tj}t| D]^\} }|jd|d}|jd |d}|j tj tj | |d||d|j tj tjjtj|d||d ||d|d\}|j tj|||| |dtj||d }|||| <q|j tj||d||fS) a Modify the FunctionIR to create a single common exit node given the original exit nodes. Parameters ---------- func_ir : The FunctionIR. Mutated inplace. exit_nodes : The original exit nodes. A sequence of block keys. split_condition : callable or None If not None, it is a callable with the signature `split_condition(statement)` that determines if the `statement` is the splitting point (e.g. `POP_BLOCK`) in an exit node. If it's None, the exit node is not split. rrNrz$cp)r'rrQrz $cp_checkz$cp_rhs)fnlhsrhsrQrO)r-rZr5rPrrrU unknown_loc enumerater"r1rQr&Const get_or_define is_terminatedrredefinerbinopoperatoreqgetrr)rq exit_nodesr:r-any_blkrPr& common_block common_label post_block post_label remainingsirr*ptrbeforeafterrQ remain_blocksr switch_block match_expr match_rhs jump_targetr r rrs4         r))__doc__ collectionsrrloggingrFnumba.core.analysisrrrrrrr numba.core.utilsr getLogger__name__rr3rDrHrNrYr`r|rrrrrrrrrrrrrlrrr r r rs@  5!/F;9^k