o -i@sUddlmZmZmZddlmZddlmZddlm Z ddl m Z e e Z edZeeZeedfed<ed ZeeZeedfed <eeGd d d Zd efddZdS))AnyLiteralget_args) dataclass)config) init_logger) safe_hash)CLSLASTMEAN.SEQ_POOLING_TYPES)ALLSTEPTOK_POOLING_TYPESc@s6eZdZUdZdZeeBdBed< dZedBed< dZ edBed< dZ e dBed< dZ e dBed< dZe dBed< dZe dBed < dZedBed < dZedBed < dZe dBed < dZedBed < dZe dBed< dZee dBed< ddZdefddZdefddZdefddZdS) PoolerConfigz:Controls the behavior of output pooling in pooling models.N pooling_typeseq_pooling_typetok_pooling_type normalize dimensionsenable_chunked_processing max_embed_lensoftmax activationuse_activation logit_bias step_tag_idreturned_token_idscCst||_|j}r@|jdurtd|jdurtd|tvr,td||||_dS|t vr