o پi@sddlmZmZddlmZddlZddlmZddlmZddl m Z ddl m Z ddl m Z Gd d d ejeZGd d d e eZdS) )ABCabstractmethod)AnyN)nn) DiTConfig)TeaCacheContext) TeaCacheMixin)AttentionBackendEnumc seZdZUgZeed<gZeed<eed<eed<eed<eed<eed<e j Z e e ed<dfd d Z d e deeefd d ffdd Ze ddejdejeejBdejdejeejBd Bd ejf ddZdddZed e e fddZed ejfddZZS)BaseDiT_fsdp_shard_conditions_compile_conditionsparam_names_mappingreverse_param_names_mapping hidden_sizenum_attention_headsnum_channels_latents_supported_attention_backendsreturnNcs:gd}t|D]}t||std|dq dS)N)r r r #Subclasses of BaseDiT must define 'z' class variable)super__init_subclass__hasattrAttributeError)clsrequired_class_attrsattr __class__b/home/ubuntu/.local/lib/python3.10/site-packages/sglang/multimodal_gen/runtime/models/dits/base.pyr"s   zBaseDiT.__init_subclass__config hf_configc s4t||_||_|jstd|jjddS)Nz Subclass z* must define _supported_attention_backends)r__init__r r!supported_attention_backends ValueErrorr__name__)selfr r!kwargsrrrr"/s zBaseDiT.__init__ hidden_statesencoder_hidden_statestimestepencoder_hidden_states_imagecKsdSNr)r&r(r)r*r+guidancer'rrrforward8s zBaseDiT.forwardcCs0gd}|D]}t||std|dqdS)N)rrrrz' instance variable)rr)r&required_attrsrrrr __post_init__Ds  zBaseDiT.__post_init__cCs|jSr,)rr&rrrr#Lsz$BaseDiT.supported_attention_backendscCst|jS)zGet the device of the model.)next parametersdevicer1rrrr4PszBaseDiT.device)rN)NN)r% __module__ __qualname__r list__annotations__r dictintrrsetr rstrrr"rtorchTensor LongTensorr.r0propertyr#r4 __classcell__rrrrr s>  "   r cseZdZUdZgZiZiZiZee d<e e d<e e d<e e d<e j Z e ee d<de dd ffd d Zedeeeeefffd d ZZS) CachableDiTz An intermediate base class that adds TeaCache optimization functionality to DiT models. Inherits TeaCacheMixin for cache logic and BaseDiT for core DiT functionality. lora_param_names_mappingrrrrr rNc s tj|fi||dSr,)rr"_init_teacache_state)r&r r'rrrr"ks zCachableDiT.__init__cCsiS)aW Get quantization rules for Nunchaku quantization. Returns a dict mapping layer name patterns to quantization configs: { "skip": [list of patterns to skip quantization], "svdq_w4a4": [list of patterns for SVDQ W4A4], "awq_w4a16": [list of patterns for AWQ W4A16], } r)rrrrget_nunchaku_quant_rulesos z$CachableDiT.get_nunchaku_quant_rules)r%r5r6__doc__r r rrCr9r8r:rrr;r r" classmethodr<rrErArrrrrBVs  (rB)abcrrtypingrr=r$sglang.multimodal_gen.configs.modelsr,sglang.multimodal_gen.runtime.cache.teacacherr'sglang.multimodal_gen.runtime.platformsr Moduler rBrrrrs      A