o *i#@s~ddlmZmZddlmZmZddlmZddlm Z gdZ eGdddeZ eGdd d eZ Gd d d ee Z d S) )Enumunique)ListOptional) RegistryMixin) BaseModel)SparsityCompressionConfigCompressionFormatSparsityStructurec@s8eZdZdZdZdZdZdZdZdZ dZ d Z d Z d Z d S) r densezsparse-bitmaskzsparse-24-bitmaskz int-quantizedzfloat-quantizedznaive-quantizedzpack-quantizedz marlin-24zmixed-precisionznvfp4-pack-quantizedzmxfp4-pack-quantizedN)__name__ __module__ __qualname__r sparse_bitmasksparse_24_bitmask int_quantizedfloat_quantizednaive_quantizedpack_quantized marlin_24mixed_precisionnvfp4_pack_quantizedmxfp4_pack_quantizedrr[/home/ubuntu/veenaModal/venv/lib/python3.10/site-packages/compressed_tensors/config/base.pyr sr c@s0eZdZdZdZdZdZddZeddZ d S) r as An enumeration to represent different sparsity structures. Attributes ---------- TWO_FOUR : str Represents a 2:4 sparsity structure. ZERO_ZERO : str Represents a 0:0 sparsity structure. UNSTRUCTURED : str Represents an unstructured sparsity structure. Examples -------- >>> SparsityStructure('2:4') >>> SparsityStructure('unstructured') >>> SparsityStructure('2:4') == SparsityStructure.TWO_FOUR True >>> SparsityStructure('UNSTRUCTURED') == SparsityStructure.UNSTRUCTURED True >>> SparsityStructure(None) == SparsityStructure.UNSTRUCTURED True >>> SparsityStructure('invalid') Traceback (most recent call last): ... ValueError: invalid is not a valid SparsityStructure z2:4 unstructuredz0:0cCs*t|}|dur||_|S||_|S)N)object__new__lower_value_)clsvalueobjrrrrQs zSparsityStructure.__new__cCsB|dur|jS|D] }|j|kr|Sq t|d|j)Nz is not a valid ) UNSTRUCTUREDr!r ValueErrorr )r r!memberrrr _missing_VszSparsityStructure._missing_N) r r r__doc__TWO_FOURr# ZERO_ZEROr classmethodr&rrrrr (s#r c@sbeZdZUdZeed<dZeeeed<dZ eeeed<dZ ee ed<dZ eeed <dS) ra Base data class for storing sparsity compression parameters :param format: name of compression format :param targets: List of layer names or layer types that aren't sparse and should be ignored during compression. By default, assume all layers are targeted :param ignore: List of layer names (unique) to ignore from targets. Defaults to None :param global_sparsity: average sparsity of the entire model :param sparsity_structure: structure of the sparsity, such as "unstructured", "2:4", "8:16" etc formatNtargetsignoregglobal_sparsityrsparsity_structure) r r rr'str__annotations__r,rrr-r.floatr/rrrrras  rN)enumrrtypingrrcompressed_tensors.registryrpydanticr__all__r r rrrrrs  8