o i@sddlmZddlZddlZddlZddlZddlZddlZddlm Z ddl m Z dej vrIe e j j j j drIejdee e j j j ddlmZedZed ZdddZdddZedkrledSdS)) annotationsN)Path)tqdm NO_LOCAL_GGUFzgguf-py) GGUFReaderz gguf-hashz$ef001206-dadc-5f6d-a15f-3359e577d4e5readerrfilenamestrdisable_progress_barboolno_layerreturnNonecCst}t}t}|tjd}t|jdD]\}} | j dr%qd} | j D]} | | 9} q*|| 7}qt d|dd|d} |jD]_} | j drKqBd} | j D]} | | 9} qP| | |st} | | j j t d| || jt}|| j j t d ||| j|| j j || j j || j j qB| t d ||t d ||t d tj|dd dd|dS)Nr)z.attention.masked_biasz.attention.biasz.rotary_emb.inv_freqHashingweightsT)desctotalunit unit_scaledisablezsha1 {0} {1}:{2}zsha256 {0} {1}:{2}zsha1 {0} {1}zsha256 {0} {1}zuuid {0} {1})bytesversion)hashlibsha1sha256updateUUID_NAMESPACE_LLAMA_CPPr enumeratetensorsnameendswithshaperdataprintformat hexdigestcloseuuidUUIDdigest)rrr r rr uuidv5_sha1 total_weightsntensorsum_weights_in_tensordimbar sha1_layer sha256_layerr6S/home/ubuntu/veenaModal/venv/lib/python3.10/site-packages/gguf/scripts/gguf_hash.py gguf_hashsD          *r8cCstjdd}|jdtdd|jdddd |jd dd d |jd dd d |ttjdkr1dndg}tj |j r=tj ntj dt |jd}t||j|j |jdS)NzDump GGUF file metadata) descriptionmodelzGGUF format model filename)typehelpz --no-layer store_truezexclude per layer hash)actionr<z --verbosezincrease output verbosityz --progressbarzenable progressbarrz--help)levelr)argparseArgumentParser add_argumentr parse_argslensysargvlogging basicConfigverboseDEBUGINFOrr:r8 progressbarr )parserargsrr6r6r7mainYs  rP__main__) rrrr r r r r r r)r r) __future__rr*rrHrAosrFpathlibrrenviron__file__parentexistspathinsertr ggufr getLoggerloggerr+rr8rP__name__r6r6r6r7s&   "     ;