o i@s^ddlmZddlZddlZddlZddlmZddlmZm Z m Z ddl m Z m Z e r6ddlZddlmZejddkrHedd(d dZnd(ddZGdddeZGdddeZGdddeZGdddeZGdddeZGdddeZGdddeZGdddeZGd d!d!eZGd"d#d#e ZGd$d%d%e ZGd&d'd'e Z dS))) annotationsN) lru_cache)AnyOptional TYPE_CHECKING)BackendCompilerFailedShortenTraceback)_CudaDevicePropertiesTORCHINDUCTOR_WRITE_MISSING_OPS1targetrreturnNonecCsLttdd}|t|dWddS1swYdS)Nz/missing_ops.txta )opentempfile gettempdirwritestr)r fdrI/home/ubuntu/vllm_env/lib/python3.10/site-packages/torch/_inductor/exc.py_record_missing_ops"rcCsdSNr)r rrrrsc@seZdZed d d Zd S) OperatorIssuer rargs list[Any]kwargsdict[str, Any]r rcCsDd|gddt|D}|r|d|td|dS)Nztarget: cSs g|] \}}d|d|qS)zargs[z]: r).0iargrrr !sz.OperatorIssue.operator_str..zkwargs: rz ) enumerateappendtextwrapindentjoin)r rrlinesrrr operator_strs zOperatorIssue.operator_strN)r rrrrrr r)__name__ __module__ __qualname__ staticmethodr*rrrrrsrceZdZd fd d ZZS) MissingOperatorWithoutDecompr rrrrrr rcs(t|td||||dS)Nzmissing lowering )rsuper__init__r*selfr rr __class__rrr2*s z%MissingOperatorWithoutDecomp.__init__r rrrrrr rr+r,r-r2 __classcell__rrr5rr0)r0cr/) MissingOperatorWithDecompr rrrrrr rcs:t|td||||td|ddS)Nzmissing decomposition z9 There is a decomposition available for z in torch._decomp.get_decompositions(). Please add this operator to the `decompositions` list in torch._inductor.decomposition )rr1r2r*r&dedentr3r5rrr20sz"MissingOperatorWithDecomp.__init__r7r8rrr5rr;/r:r;cseZdZd fd d ZZS)LoweringExceptionexc Exceptionr rrrrrr rc s0tt|jd|d||||dS)N: r)r1r2typer+r*)r4r>r rrr5rrr2@s"zLoweringException.__init__) r>r?r rrrrrr rr8rrr5rr=?r:r=c@ eZdZdS)SubgraphLoweringExceptionNr+r,r-rrrrrCHrCcseZdZdfdd ZZS)InvalidCxxCompilerr rcs.ddlm}td|jd|jjdS)N)configz!No working C++ compiler found in z .cpp.cxx: )rHr1r2r+cppcxx)r4rHr5rrr2Ms zInvalidCxxCompiler.__init__)r rr8rrr5rrFLr:rFceZdZdfdd ZZS)CppWrapperCodegenErrormsgrr rcstd|dS)NzC++ wrapper codegen error: r1r2)r4rNr5rrr2VszCppWrapperCodegenError.__init__)rNrr rr8rrr5rrMUr:rMcs(eZdZd fdd Zd d d ZZS)CppCompileErrorcmd list[str]outputrr rcsJt|tr |d}||_||_ttd j d ||ddS)Nzutf-8z C++ compile error Command: {cmd} Output: {output}  )rQrS) isinstancebytesdecoderQrSr1r2r&r<stripformatr()r4rQrSr5rrr2[s   zCppCompileError.__init__"tuple[type, tuple[list[str], str]]cCs|j|j|jffSr)r6rQrS)r4rrr __reduce__rszCppCompileError.__reduce__)rQrRrSrr r)r rZ)r+r,r-r2r[r9rrr5rrPZsrPc@rB)CUDACompileErrorNrDrrrrr\vrEr\crL) TritonMissingfirst_useful_frameOptional[types.FrameType]r rcstjd|ddS)NzCannot find a working triton installation. Either the package is not installed or it is too old. More information on installing Triton can be found at: https://github.com/triton-lang/tritonr^rO)r4r^r5rrr2{s zTritonMissing.__init__)r^r_r rr8rrr5rr]zr:r]cseZdZd fdd ZZS) GPUTooOldForTriton device_propsr r^r_r rcs,tjd|jd|jd|j|ddS)NzFound z which is too old to be supported by the triton GPU compiler, which is used as the backend. Triton only supports devices of CUDA Capability >= 7.0, but your device is of CUDA capability .r`)r1r2namemajorminor)r4rbr^r5rrr2s  zGPUTooOldForTriton.__init__)rbr r^r_r rr8rrr5rrar:rac@seZdZdZd dd Zd S) InductorErrorinductorinner_exceptionr?r^r_r rcCs*||_tj|t|jd||ddS)Nr@r`)rirr2rAr+)r4rir^rrrr2s  zInductorError.__init__N)rir?r^r_r r)r+r,r- backend_namer2rrrrrgsrg)r rr r)! __future__rosrr& functoolsrtypingrrrtorch._dynamo.excrrtypes torch.cudar environgetr RuntimeErrorrr0r;r=rCrFrMrPr\r]rargrrrrs4