o bi.@sddlZddlZddlZddlZddlZddlmZddlZddlZddlZddl Z ddl Z ddl Z ddl m Z mZmZmZdddedefdd Zd ejfd d ZeZd ed ejfddZdZdZdeee fd eee ffddZe je jZde fddZ!eZ"d=de fddZ#ddZ$ddZ%d eefd!d"Z&d>d eefd#d$Z'd%d&Z( ' (d?d)ed*efd+d,Z)d-d.Z*d/d0Z+d1d2Z,d3d4Z-d5d6Z.d@d8ed9ed:efd;d<Z/dS)AN) signature)Any CoroutineDictOptionalF) reload_module full_pathrcCs|durtdd|vr#|ddkrtd|d|d\}}n|d}|d|}||dd}t|}|rBt|t||S)aGiven a full import path to a module attr, return the imported attr. If `reload_module` is set, the module will be reloaded using `importlib.reload`. For example, the following are equivalent: MyClass = import_attr("module.submodule:MyClass") MyClass = import_attr("module.submodule.MyClass") from module.submodule import MyClass Returns: Imported attr Nzimport path cannot be None:zGot invalid import path "z-". An import path may have at most one colon..) TypeErrorcount ValueErrorsplitrfind importlib import_modulereloadgetattr)rr module_name attr_namelast_period_idxmodulerE/home/ubuntu/.local/lib/python3.10/site-packages/ray/_common/utils.py import_attrs       rreturnc Cs~tj}|jdkr;|jdkr;z t}|dusJ|WSty:}zdt|vs*Jt WYd}~Sd}~wwt S)ajGet a running async event loop if one exists, otherwise create one. This function serves as a proxy for the deprecating get_event_loop(). It tries to get the running loop first, and if no running loop could be retrieved: - For python version <3.10: it falls back to the get_event_loop call. - For python version >= 3.10: it uses the same python implementation of _get_event_loop() at asyncio/events.py. Ideally, one should use high level APIs like asyncio.run() with python version >= 3.7, if not possible, one should create and manage the event loops explicitly.  Nzno running event loop) sys version_infomajorminorasyncioget_running_loop RuntimeErrorstrget_event_loop_policyget_event_loop) vers_infolooperrrget_or_create_event_loop2s r, coroutinecCs&t|}t||tj|S)a1Schedule a task reliably to the event loop. This API is used when you don't want to cache the reference of `asyncio.Task`. For example, ``` get_event_loop().create_task(coroutine(*args)) ``` The above code doesn't guarantee to schedule the coroutine to the event loops When using create_task in a "fire and forget" way, we should keep the references alive for the reliable execution. This API is used to fire and forget asynchronous execution. https://docs.python.org/3/library/asyncio-task.html#creating-tasks )r, create_task_BACKGROUND_TASKSaddadd_done_callbackdiscard)r-taskrrrrun_background_taskVs   r4zaccelerator_type:bundle options_dictcCs|dpi}d|vsd|vrtdd|vsd|vr!tdt|vr,td||d }|d }|d}|d}|d }|d urM||d<|d urU||d<|d ur_t||d<|d urg||d<|d ursd |t|<|S)zDetermine a task's resource requirements. Args: options_dict: The dictionary that contains resources requirements. Returns: A dictionary of the resource requirements for the task. resourcesCPUGPUz@The resources dictionary must not contain the key 'CPU' or 'GPU'memoryobject_store_memoryzSThe resources dictionary must not contain the key 'memory' or 'object_store_memory'zOThe resource should not include `bundle` which is reserved for Ray. resources: num_cpusnum_gpusaccelerator_typeNgMbP?)getcopyr$PLACEMENT_GROUP_BUNDLE_RESOURCE_NAMEintRESOURCE_CONSTRAINT_PREFIX)r6r7r<r=r:r;r>rrrresources_from_ray_optionsxs>       rDlengthcCsdtjt|dS)zjGenerates random string of length consisting exclusively of - Lower-case ASCII chars - Digits )k)joinrandomchoicesRANDOM_STRING_ALPHABET)rErrrget_random_alphanumeric_stringsrLr backcCs>t}z||d}|jd|jWStyYdSw)aL Get the location (filename and line number) of a function caller, `back` frames up the stack. Args: back: The number of frames to go up the stack, not including this function. Returns: A string with the filename and line number of the caller. For example, "myfile.py:123". r r UNKNOWN)inspectstackfilenamelineno IndexError)rMrPframerrrget_call_locations   rUcCsldtjvr tjdStjdrdtjvrtjdStjds&tjdr0tjtjd}|St }|S)N RAY_TMPDIRlinuxTMPDIRdarwintmp) osenvironrplatform startswithpathrHseptempfile gettempdir)tempdirrrrget_user_temp_dirs   rdcCstjtdS)Nray)r[r_rHrdrrrrget_ray_temp_dirsrftemp_dircCs|durt}tj|dS)Nray_current_cluster)rfr[r_rH)rgrrrget_ray_address_filesricCs>t|}tj|rzt|WdStyYdSwdSN)rir[r_existsremoveOSError)rg address_filerrrreset_ray_addresss  rocCsL|d}t|dkrtdd|dd}|d}t|}t||S)z`Load a class at runtime given a full path. Example of the path: mypkg.mysubpkg.myclass r z:You need to pass a valid path like mymodule.provider_classN)rlenrrHrrr)r_ class_data module_path class_strrrrr load_classs    rv+/sys/fs/cgroup/memory/memory.limit_in_bytes/sys/fs/cgroup/memory.maxmemory_limit_filenamememory_limit_filename_v2cCsd}tj|r&t|d}t|}Wdn1s wYn,tj|rRt|d}|}|rAt|}nd}Wdn1sMwYt j }|dur`t ||S|S)aReturn the total amount of system memory in bytes. Args: memory_limit_filename: The path to the file that contains the memory limit for the Docker container. Defaults to /sys/fs/cgroup/memory/memory.limit_in_bytes. memory_limit_filename_v2: The path to the file that contains the memory limit for the Docker container in cgroups v2. Defaults to /sys/fs/cgroup/memory.max. Returns: The total amount of system memory in bytes. Nr) r[r_rkopenrBreadstrip isnumericpsutilvirtual_memorytotalmin)ryrz docker_limitfmax_filepsutil_memory_in_bytesrrrget_system_memorys$        rcCst|}|}|Srj)binasciihexlifydecode) identifierhex_identifierrrr binary_to_hex(s rcCs t|Srj)r unhexlify)rrrr hex_to_binary.s rc CsPz t|dWdSty'}z|jtjtjfvrnWYd}~dSd}~ww)Ni)r[chmodrmerrnoEACCESEPERM)directory_pathr+rrrtry_make_directory_shared2srcCs&tj|}tj|ddt|dS)NT)exist_ok)r[r_ expandusermakedirsr)rrrrtry_to_create_directoryAs  rcCstt|j}t|Srj) frozensetr parameterslist)callableall_parametersrrrget_function_argsJsrutf-8byte_str allow_none encode_typecCs4|dur|rdSt|tstd|d||S)aMake this unicode in Python 3, otherwise leave it as bytes. Args: byte_str: The byte string to decode. allow_none: If true, then we will allow byte_str to be None in which case we will return an empty string. TODO(rkn): Remove this flag. This is only here to simplify upgrading to flatbuffers 1.10.0. encode_type: The encoding type to use for decoding. Defaults to "utf-8". Returns: A byte string in Python 2 and a unicode string in Python 3. NrFz The argument z must be a bytes object.) isinstancebytesrr)rrrrrrrOs   r)r rj)rwrx)Fr)0r#rrrrOrr[rrIstringrratypingrrrrr&boolrAbstractEventLoopr,setr/Taskr4rCrArDascii_lowercasedigitsrKrBrL_PRINTED_WARNINGrUrdrfrirorvrrrrrrrrrrrsT "!" /  /