o ϯiC@sddlZddZddZdS)NcCs,|}d|vrdddddSdddddS) NvitgMb@??g\(\?gư>)lrbeta1beta2epsg+?g:0yE>)lower) model_namer N/home/ubuntu/.local/lib/python3.10/site-packages/laion_clap/training/params.pyget_default_paramssr cCst}|jdtddd|jdtddd|jdddd d |jd td d d|jdtddd|jdtddd|jdtddd|jdtddd|jdgdddd|jdtddd|jdtdd d|jd!td"d#d|jd$tdd%d|jd&tdd'd|jd(d)dd*d+|jd,d)dd-d+|jd.d)dd/d+|jd0d)dd1d+|jd2td3d4d|jd5ddd6d |jd7tdd8d|jd9td:d;d|jdd|jd?ddd@dA|jdBtddCd|jdDtdEdFd|jdGtdHdId|jdJtdKdLd|jdMtddNd|jdOtddPd|jdQtddRd|jdStddTd|jdUtddVd|jdWtdXdYd|jdZddd[dA|jd\tdd]d|jd^tdd_d|jd`tddad|jdbtddcd|jddtdXded|jdftdgdhd|jditddjd|jdktddld|jdmtddnd|jdotddpd|jdqtdXdrd|jdstdgdtd|jdutdvdwd|jdxdddyd |jdzddd[dA|jd{tdEd|d|jd}td~dd|jdddddA|jdtddd|jdtdEdd|jddtdd|jdgdddd|jdtddd|jdtddd|jddtdd|jddtdd|jddtdd|jddddd |jddddd |jdtd~dd|jddddd |jddddd |jddddd |jddddd |jddddd |jddddd |jddtdd|jddtdd|jddtdd|jddtdd|jdtddd|jddddd |jddddd |jddddd |jddddd |jddddd |jdtddd|jdtddd|jdtddd|jdtddd|jdtddd|jddddd |jddddd |jddddd |jddddd |jddtdd|jdtddd|jdtddd|jdtddd|jdtd~dd|jdtddd|jdtddd|jddddd |jdtddd|jdtd~dd|jddddd |jdtddd|jddddd |jdtddd|jdtddd|}t|j}| D]\}}t ||durt |||q|S)Nz --train-dataz!Path to h5 filewith training data)typedefaulthelpz --val-dataz$Path to h5 file with validation dataz --freeze-textF store_truez6if you need to freeze the text encoder, make this True)ractionrz--freeze-text-afterziif you need to freeze the text encoder after (include) epoch x, set this param to x. Set -1 to disable itz --train-ipczEPath to npy file of the number of instance per class in training dataz --val-ipczGPath to npy file of the number of instance per class in validation dataz--train-num-sampleszTNumber of samples in dataset. Required for webdataset if not available in info file.z--val-num-sampleszRNumber of samples in dataset. Useful for webdataset if not available in info file.z--dataset-type) webdatasetcsvautotoyrz!Which type of dataset to process.)choicesrrz--csv-separator z.For csv-like datasets, which separator to use.z --csv-img-keyfilepathz?For csv-like datasets, the name of the key for the image paths.z--csv-caption-keytitlez0z--save-most-recentz=Always save the most recent model trained to epoch_latest.pt.z--zeroshot-frequencyzHow often to run zero shot.z--val-frequencyz*How often to run evaluation with val data.z--resumez)path to latest checkpoint (default: none))rr rz --precision)ampfp16fp32r!zFloating point precision.z--amodelRN50z"Name of the audio backbone to use.z--tmodel transformerzKName of the text backbone to use. Can be [transformer, bert, roberta, bart]z--pretrained-audiozBUse a pretrained audio model weights for the audio encoder of CLAPz--pretrained-textz@Use a pretrained text model weights for the text encoder of CLAPz --pretrainedzHUse a pretrained CLIP model weights with the specified tag or file path.z--pretrained-imagezGLoad imagenet pretrained weights for image tower backbone if available.z --lock-imagez-Lock full image tower by disabling gradients.z--lock-image-unlocked-groupsz/Leave last n image tower layer groups unlocked.z--lock-image-freeze-bn-statszDFreeze BatchNorm running stats in image tower for any locked layers.z --local-lossz\calculate loss w/ local features @ global (instead of realizing full global @ global matrix)z--gather-with-gradz3enable full distributed gradient for feature gatherz--force-quick-geluzDForce use of QuickGELU activation for non-OpenAI transformer models.z --torchscriptzZtorch.jit.script the model, also uses jit version of OpenAI models if pretrained=='openai'z--tracez3torch.jit.trace the model for inference / eval onlyz --dist-urlzenv://z'url used to set up distributed trainingz--dist-backendncclzdistributed backendz --report-toz9Options are ['wandb', 'tensorboard', 'wandb,tensorboard']z --wandb-noteszNotes if logging with wandbz--CgHzG @z%inverse regularizer for logistic reg.z--debugz$If true, more information is logged.z--copy-codebasezMIf true, we copy the entire base on the log diretory, and execute from there.z --horovodz%Use horovod for distributed training.z--ddp-static-graphz= 1.11.z--no-set-device-rankz^Don't set device index from local rank (when CUDA_VISIBLE_DEVICES restricted to one per proc).z--seedizDefault random seed.z!--top-k-checkpoint-select-datasetallz*The dataset of selecting top-k checkpoint.z --top-k-checkpoint-select-metricz_R@10z*The metric for selecting top-k checkpoint.z--openai-model-cache-dirz ~/.cache/clipz$Directory to download OpenAI models.z --optimizeradamwzcan be AdamW or SGDz--parallel-evalz)Eval in parallel (multi-GPU, multi-node).z --no-evalzTraining without evaluation.z--lp-mlpz$Linear Probe using MLP layer or not.z --lp-freezez%Linear Probe using Freeze CLAP or notz--lp-actNonez6Options are ['relu','elu','prelu','softmax','sigmoid']z --lp-lossbcezLoss func of Linear Probe.z --lp-metricsz map,mauc,acczMetrics of Linear Probe.z--lp-lrg-C6?zlearning rate of linear probez--kappaz`the kappa in the weighted contrastive loss, default is to turn off the weighted contrastive lossz--data-fillingpadz}type of data filling when the audio length is shorter than the max length.Can be one of the following: repeat, repeatpad, padz--data-truncating rand_truncz{type of data truncation when the audio length is longer than the max length.Can be one of the following: rand_trunc, fusionz--clap-mlplossz$Using MLP loss for CLAP model or notz --wandb-idz&the id of wandb experiment to restore.z--sleepz%sleep n seconds before start trainingz--enable-fusionz/Enable feature funsion for variable-length dataz --fusion-typezVType is among ['channel_map', 'daf_1d','aff_1d','iaff_1d','daf_2d','aff_2d','iaff_2d']z--mixupz$Enable mixup in finetuning training.z--text-augment-selectionzUFor selecting levels of augmented text. Type is among ['all', 'augment_only', 'none']z--prefetch-factorzYThe prefetch factor for dataloader. Larger value will use more memory and CPU but faster.) argparseArgumentParser add_argumentstrintfloat parse_argsr amodelitemsgetattrsetattr)parserargsdefault_paramsnamevalr r r r4 s"  r4)r.r r4r r r r s