o پiy @sdddlZddlZddlZeeZddZdejdedededejf d d Z Gd d d ej j Z dS) NcCs"td|}|rt|dSdS)Nzlayers\.(\d+)\.)researchintgroup) weight_namematchr R/home/ubuntu/.local/lib/python3.10/site-packages/sglang/srt/layers/utils/common.py get_layer_id s r loaded_weight input_dim start_idx shard_sizereturncCst|j||d}|dkr3||||}t|j}||||<tj||j|jd}tj||g|dSt|j}|||<tj||j|jdS)Nr)dtypedevice)dim) maxshapenarrowlisttorchzerosrrcat)r r rr valid_size loaded_slice pad_shapepadr r r pad_or_narrow_weights     rcs(eZdZdZfddZddZZS)PPMissingLayerzN A placeholder layer for missing layers in a pipeline parallel model. cst|dd|_dS)N return_tupleF)super__init__getr!)selfargskwargs __class__r r r#/s zPPMissingLayer.__init__cOs,|r|dntt|}|jr|fS|S)z Return the first arg from args or the first value from kwargs. Wraps the input in a tuple if `self.return_tuple` is True. r)nextitervaluesr!)r%r&r'inputr r r forward3szPPMissingLayer.forward)__name__ __module__ __qualname____doc__r#r. __classcell__r r r(r r (s r ) loggingrr getLoggerr/loggerr TensorrrnnIdentityr r r r r s"