o -i4%@sddlZddlZddlZddlmZddlmZddlmZddl m Z m Z m Z m Z mZmZddlmZddlmZmZmZmZmZmZddlmZdd lmZ ed ZeeZ Gd d d ee eZ!Gd dde eZ"GdddeZ#dS)N)abstractmethod) defaultdict)chain)AnyCallableGenericOptionalTypeVarUnion)override)_serialize_single_cache CacheArtifactCacheArtifactFactoryCacheArtifactManagerCacheArtifactsResult CacheInfo)AppendingByteSerializer) OrderedSetTc@sBeZdZdZed ddZedefddZede fdd Z dS) PrecompileCacheArtifacta5 Data for each cache artifact that will be serialized and deserialized by PrecompileContext, rather than CacheArtifactManager. T represents the deserialized type of the artifact, i.e. the return type of after_deserialization PrecompileCacheArtifact is a frozen dataclass - you can add new serializable fields and metadata specific to your own artifacts as needed, and use them in after_deserialization. Example implementation: class MyPrecompileCacheArtifact(PrecompileCacheArtifact[MySerializableType]): my_field: int def after_deserialization(self) -> MySerializableType: result = pickle.loads(self.content) # Do some extra work post deserialization result.my_post_deserialization_function(self.my_field) return result returnNcCstd)Nz1Precompile cache artifacts do not populate caches) RuntimeErrorselfrY/home/ubuntu/LTX-2/.venv/lib/python3.10/site-packages/torch/_dynamo/precompile_context.pypopulate_cache3sz&PrecompileCacheArtifact.populate_cachecCdS)NTrrrrrprecompile_compatible7sz-PrecompileCacheArtifact.precompile_compatiblecCr)z Code to be run after reading raw byte contents from disk. Generally converts self.content from raw bytes back into its original form. Nrrrrrafter_deserialization;sz-PrecompileCacheArtifact.after_deserializationrN) __name__ __module__ __qualname____doc__r rboolrrrrrrrrrs rc@sVeZdZdZdedededdfddZdeefd d Z d e d efddfd dZ dS)EditablePrecompileCacheArtifactzk A PrecompileCacheArtifact whose content isn't encoded until we call PrecompileContext.serialize() artifact_typecontentkeyrNcCst||_||_||_dSN)copydeepcopyr(r)r')rr'r(r)rrr__init__Is  z(EditablePrecompileCacheArtifact.__init__cCs0t|j}t|j|j|}t|tsJ|S)z, Actually encode the object ) pickledumpsr(r encode_creater'r) isinstancer)rr(artifactrrr real_encodePs  z+EditablePrecompileCacheArtifact.real_encodeedit_fn.cCs||j|_dS): Edit the content of an existing artifact N)r()rr4rrr edit_contents[sz-EditablePrecompileCacheArtifact.edit_contents) r!r"r#r$strrr-rrr3rr6rrrrr&Ds  r&c sTeZdZUdZiZeeeee e ffe d<e e Zee d<eZee e d<eedZeeee e fe d<eZee d<ed"fd d Zee d#d ededededd f ddZed"ddZedededefdd fddZ edede!e fddZ"ede!ee#efffdd Z$e%dedefddZ&ed"d d!Z'Z(S)$PrecompileContexta@ PrecompileContext is a special CacheArtifactManager for handling precompilation It uses the same interface as CacheArtifactManager, but handles deserialization differently: instead of placing each artifact into respective caches, it will stitch all the cache artifacts for a single key together and place it into a global Precompile Cache. The following artifact types are supported by PrecompileContext: - BundledAOTAutogradCacheArtifact - DynamoCodeStateArtifact - AutotuneCacheArtifact (regular autotune results, same as Megacache) _new_cache_artifacts_by_key_new_cache_artifacts_seen_artifacts) serialize_fn _serializer _cache_inforNcs|jtdSr*)r9clearsupercls __class__rrr?s zPrecompileContext.clearFr'r)r(editablecCsH|r t|||}nt|||}||jvrdS|j|||j|<dS)zg Called from each caching operation to record the artifact in this "mega" list N)r&rr0r;addr9)rBr'r)r(rEr2rrrrecord_artifacts  z!PrecompileContext.record_artifactcCsF|jD]}t|tr|}|j|j|q|j dS)z We normally record artifacts by key, but serialization expects them to be organized by artifact type. This function transfers artifacts from _new_cache_artifacts_by_key to _new_cache_artifacts N) r9valuesr1r&r3r:rDtypeappendr?)rBr2rrr_save_artifacts_by_types  z)PrecompileContext._save_artifacts_by_typer4.cCsD||jvs Jd|d|j|}t|tsJd||dS)r5zKey  not found in artifactszArtifact is not editableN)r9r1r&r6)rBr)r4r2rrr edit_artifacts    zPrecompileContext.edit_artifactcCs$|j|d}t|tr|}|S)zP Serialize all artifacts with the given key returned in a list. N)r9getr1r&r3)rBr)resultrrrserialize_artifact_by_keys z+PrecompileContext.serialize_artifact_by_keycs |d|jvr dStS)Nprecompile_dynamo)rKr:r@ serializerArCrrrRs  zPrecompileContext.serialize artifactsc Csti}t}t|D]}|dkr|n|||j<||qddl m }m }|dD]:}t |t s classmethodr?r rr%rGrKrrMrrPbytesrR staticmethodrbrW __classcell__rrrCrr8bsN     r8)$r+loggingr.abcr collectionsr itertoolsrtypingrrrrr r typing_extensionsr torch.compiler._cacher r rrrr&torch.utils._appending_byte_serializerrtorch.utils._ordered_setrr getLoggerr!loggerrr&r8rrrrs"         &