o Xi)@snddlmZddlmZmZmZGdddejZegej ddd ej dd d Z e e Z d S) ) annotations) _fusion_utils _ir_utilspatterncs<eZdZdZdfdd Zdd Zdd d ZddZZS)BiasGeluFusionzFuses a Bias-Gelu pattern into a single BiasGelu operator. Attributes: contrib_op (bool): If True, matches the Gelu operator from the 'com.microsoft' domain. If False, matches the standard ONNX Gelu operator. namestr contrib_opboolcst|||_dS)N)super__init__ _contrib_op)selfrr  __class__]/home/ubuntu/.local/lib/python3.10/site-packages/onnxscript/rewriter/ort_fusions/bias_gelu.pyr s  zBiasGeluFusion.__init__cCs4|||}|jr|j|ddgdS|j|dgdS)N com.microsoftgelu)_domain_outputs)r)Addr Gelu)ropinputbiasgelu_addrrrrs zBiasGeluFusion.patternreturnpattern.MatchResultcKsNt}|jd}|dur|dkr|dSt|ds%|d|S|S)N approximatetanhz@Gelu operator with 'approximate' set to 'tanh' is not supported.zbias is not of shape 1D tensor)r MatchResultproducer attributes get_stringfailrhas_rank)rrrrr_ check_resultrrrrcheck!s  zBiasGeluFusion.checkcKs|j||ddS)Nr)r)BiasGelu)rrrrr(rrrrewrite.szBiasGeluFusion.rewrite)rrr r )rr) __name__ __module__ __qualname____doc__r rr*r, __classcell__rrrrrs   r gelu_onnx_opF)r gelu_contrib_opTN) __future__ronnxscript.rewriterrrrRewriteRuleClassBaserRewriteRuleSetrulecommutebias_gelu_rulesapply_fusion_rulesfuse_bias_gelurrrrs *