o پi$@svddlZddlZddlmZddlmZmZddlZddlm Z ddl m Z ddl m Z eeZGddde ZdS) N)Iterable)OptionalUnion)auto_functionalized)is_func)SGLangInductorPassc @seZdZdZdejjfddZdeejj e ejj ffddZ ddejjd ejj d e e eejj effd eeeejj efd ffd dZd ejj d e e eejj efffddZd ejj de e ejj ffddZ ddejjd ejj d eeeejj efd ffddZdS)FixFunctionalizationPassa" This pass defunctionalizes certain nodes to avoid redundant tensor copies. After this pass, DCE (dead-code elimination) should never be run, as de-functionalized nodes may appear as dead code. To add new nodes to defunctionalize, add to the if-elif chain in __call__. graphcCs|||dg|_d}|jD] }t|tsq|d7}q||dt|j}|jD]}||q-t d||||d| dS)Nbefore_fix_functionalizationr$before_fix_functionalization_cleanupz,De-functionalized %s nodes, removed %s nodesafter_fix_functionalization) begin dump_graphnodes_to_removenodesrrlen erase_nodeloggerdebug end_and_log)selfr countnode count_removedr`/home/ubuntu/.local/lib/python3.10/site-packages/sglang/srt/compilation/fix_functionalization.py__call__s"          z!FixFunctionalizationPass.__call__ node_or_nodescCs.t|tjjr|j|dS|j|dS)zM Stage a node (or nodes) for removal at the end of the pass. N) isinstancetorchfxNoderappendextend)rrrrr_remove2sz FixFunctionalizationPass._removeNr mutated_argsargs.cCs*||||j|||d||dS)z De-functionalize a node by replacing it with a call to the original. It also replaces the getitem users with the mutated arguments. See replace_users_with_mutated_args and insert_defunctionalized. r'N)replace_users_with_mutated_argsinsert_defunctionalizedr%)rr rr&r'rrrdefunctionalize;s z(FixFunctionalizationPass.defunctionalizecCsP||D]\}}||}t|tr|j|n|}||||qdS)a7 Replace all getitem users of the auto-functionalized node with the mutated arguments. :param node: The auto-functionalized node :param mutated_args: The mutated arguments, indexed by getitem index. If the value of an arg is a string, `node.kwargs[arg]` is used. N) getitem_usersitemsrstrkwargsreplace_all_uses_withr%)rrr&idxuserargrrrr)Ks    z8FixFunctionalizationPass.replace_users_with_mutated_argsreturncCs2i}|jD]}t|tjr|jd}|||<q|S)z Returns the operator.getitem users of the auto-functionalized node, indexed by the index they are getting. r )usersroperatorgetitemr')rrr5r2r1rrrr,[s   z&FixFunctionalizationPass.getitem_userscstts Jdd|5jd}|dur%|j|jdntfdd|D}|j||dWddSWddS1sJwYdS) a> Insert a new defunctionalized node into the graph before node. If one of the kwargs is 'out', provide args directly, as node.kwargs cannot be used. See https://github.com/pytorch/pytorch/blob/a00faf440888ffb724bad413f329a49e2b6388e7/torch/_inductor/lowering.py#L351 :param graph: Graph to insert the defunctionalized node into :param node: The auto-functionalized node to defunctionalize :param args: If we cannot use kwargs, specify args directly. If an arg is a string, `node.kwargs[arg]` is used. z%node must be auto-functionalized, is z insteadrN)r/c3s(|]}t|trj|n|VqdSN)rr.r/).0r3rrr s zCFixFunctionalizationPass.insert_defunctionalized..r()rrinserting_beforer' call_functionr/tuple)rr rr'functionrr:rr*gs     "z0FixFunctionalizationPass.insert_defunctionalizedr8)__name__ __module__ __qualname____doc__r r!Graphrrr"rr%dictintr.rr>r+r)r,r*rrrrrs8"  "r)loggingr6collections.abcrtypingrrr *torch._higher_order_ops.auto_functionalizersglang.srt.compilation.fx_utilsr$sglang.srt.compilation.inductor_passr getLoggerr@rrrrrrs