o `Û·ið#ã@sŽddlZddlZddlZddlmZddlmZmZmZm Z m Z m Z ddl m Z mZerLddlmZddlmZddlmZddlmZdd lmZmZhd £Zhd £Zhd £Zd dhZhd£ZGdd„deƒZde de e fdd„Z!d7dd„Z"dd„Z#de d fdd„Z$d8d!d"„Z%d#d$„Z&d%d&„Z'd'e ed(d)ee e(ffd*d+„Z)d'e ed(d)e*fd,d-„Z+d9d0d1„Z,d)e*fd2d3„Z-d4ed)dfd5d6„Z.dS):éN)ÚEnum)Ú TYPE_CHECKINGÚDictÚListÚOptionalÚSetÚUnion)ÚTagKeyÚrecord_extra_usage_tag)ÚStorageContext©Ú BaseTrainer©ÚCallback©ÚTrialScheduler©ÚBasicVariantGeneratorÚSearcher>Ú TorchTrainerÚHorovodTrainerÚXGBoostTrainerÚLightGBMTrainerÚTensorflowTrainer>Ú JaxTrainerrrrrÚDataParallelTrainer>ÚAxSearchÚTuneBOHBÚ HEBOSearchÚ ZOOptSearchÚ OptunaSearchÚBayesOptSearchÚHyperOptSearchÚNevergradSearchÚConcurrencyLimiterÚRepeater> ÚPB2Ú FIFOSchedulerÚHyperBandForBOHBÚHyperBandSchedulerÚMedianStoppingRuleÚAsyncHyperBandSchedulerÚPopulationBasedTrainingÚResourceChangingSchedulerÚPopulationBasedTrainingReplayc@seZdZdZdZdZdZdS)Ú AirEntrypointz Tuner.fitz Trainer.fitztune.runztune.run_experimentsN)Ú__name__Ú __module__Ú __qualname__ÚTUNERÚTRAINERÚTUNE_RUNÚTUNE_RUN_EXPERIMENTS©r7r7úM/home/ubuntu/vllm_env/lib/python3.10/site-packages/ray/air/_internal/usage.pyr/Cs r/Úallowed_module_path_prefixÚ whitelistcCs(|j}|jj}| |¡r||vr|SdS)aFind the class name of the object. If the object is not under `allowed_module_path_prefix` or if its class is not in the whitelist, return "Custom". Args: obj: The object under inspection. allowed_module_path_prefix: If the `obj`'s class is not under the `allowed_module_path_prefix`, its class name will be anonymized. whitelist: If the `obj`'s class is not in the `whitelist`, it will be anonymized. Returns: The class name to be tagged with telemetry. ÚCustom)r1Ú __class__r0Ú startswith)Úobjr9r:Ú module_pathÚcls_namer7r7r8Ú_find_class_nameJs rAÚtrainerr cCó6ddlm}t||ƒs J‚t|dtƒ}ttj|ƒdS)Nrr ú ray.train)Úray.train.trainerr Ú isinstancerAÚ AIR_TRAINERSr r Ú AIR_TRAINER)rBr Ú trainer_namer7r7r8Útag_air_trainer`ó  rJcCrC)Nr)rrD)Ú&ray.train.v2.api.data_parallel_trainerrrFrAÚTRAIN_V2_TRAINERSr r Ú TRAIN_TRAINER)rBrrIr7r7r8Útag_train_v2_trainerhrKrOÚsearchercCsjddlm}m}t||ƒrttjdƒdSt||ƒr1t|dt  t ¡ƒ}|t vr)dSttj|ƒdSJdƒ‚)Nrrrzray.tune.searchFzZNot expecting a non-BasicVariantGenerator, non-Searcher type passed in for `tag_searcher`.) Úray.tune.searchrrrFr r Ú TUNE_SEARCHERrAÚTUNE_SEARCHERSÚunionÚTUNE_SEARCHER_WRAPPERS)rPrrÚ searcher_namer7r7r8Ú tag_searcherps   ÿÿrWÚ schedulerrcCrC)Nrrzray.tune.schedulers)Úray.tune.schedulersrrFrAÚTUNE_SCHEDULERSr r ÚTUNE_SCHEDULER)rXrÚscheduler_namer7r7r8Ú tag_scheduler†rKr]cCóttjdƒdS©NÚ1)r r Ú AIR_SETUP_WANDB_INTEGRATION_USEDr7r7r7r8Útag_setup_wandbŽórbcCr^r_)r r Ú!AIR_SETUP_MLFLOW_INTEGRATION_USEDr7r7r7r8Útag_setup_mlflow’rcreÚ callbacksrÚreturnc Csìddlm}ddlm}ddlm}ddlm}ddlm }ddl m }ddl m }||||f|}d d „|Dƒ} t t¡} |pAg}|D]/} t| |ƒsLqD| jj} | | vr]| | d 7<qDt| |ƒrk| d d 7<qD| d d 7<qD| S)zHCreates a map of callback class name -> count given a list of callbacks.r)ÚCometLoggerCallback)ÚMLflowLoggerCallback)ÚWandbLoggerCallbackr)ÚLoggerCallback)ÚAimLoggerCallback)ÚDEFAULT_CALLBACK_CLASSEScSsg|]}|j‘qSr7)r0)Ú.0Ú callback_clsr7r7r8Ú §sz$_count_callbacks..éÚCustomLoggerCallbackÚCustomCallback)Úray.air.integrations.cometrhÚray.air.integrations.mlflowriÚray.air.integrations.wandbrjÚray.tunerÚray.tune.loggerrkÚray.tune.logger.aimrlÚray.tune.utils.callbackrmÚ collectionsÚ defaultdictÚintrFr<r0) rfrhrirjrrkrlrmÚbuilt_in_callbacksÚcallback_namesÚcallback_countsÚcallbackÚ callback_namer7r7r8Ú_count_callbacks–s6       üû   rƒcCs2|sdSt|ƒ}|rt |¡}ttj|ƒdSdS)aRecords built-in callback usage via a JSON str representing a dictionary mapping callback class name -> counts. User-defined callbacks will increment the count under the `CustomLoggerCallback` or `CustomCallback` key depending on which of the provided interfaces they subclass. NOTE: This will NOT track the name of the user-defined callback, nor its implementation. This will NOT report telemetry if no callbacks are provided by the user. Returns: bool: True if usage was recorded, False otherwise. FN)rƒÚjsonÚdumpsr r Ú AIR_CALLBACKS)rfr€Úcallback_counts_strr7r7r8Ú tag_callbacks¼s þrˆÚstorager cCs>hd£}|jr d}n |jj|vr|jj}nd}ttj|ƒdS)a§Records the storage configuration of an experiment. The storage configuration is set by `RunConfig(storage_path, storage_filesystem)`. The possible storage types (defined by `pyarrow.fs.FileSystem.type_name`) are: - 'local' = pyarrow.fs.LocalFileSystem. This includes NFS usage. - 'mock' = pyarrow.fs._MockFileSystem. This is used for testing. - ('s3', 'gcs', 'abfs', 'hdfs'): Various remote storage schemes with default implementations in pyarrow. - 'custom' = All other storage schemes, which includes ALL cases where a custom `storage_filesystem` is provided. - 'other' = catches any other cases not explicitly handled above. >Ús3ÚgcsÚabfsÚhdfsÚmockÚlocalÚcustomÚotherN)Úcustom_fs_providedÚstorage_filesystemÚ type_namer r ÚAIR_STORAGE_CONFIGURATION)r‰r:Ústorage_config_tagr7r7r8Útag_storage_typeÕs  r—cCs|ddlm}ddlm}ddlm}ttƒ |||¡ƒ}g}|D] }|t j vr,|  |¡q |rs@       þ   "&