o $i1 @s"ddlZddlZddlZddlZddlZddlZddlZddlZddlZddl Z ddl Z ddl m Z m Z ddlmZddlmZddlmZmZmZmZmZddlZddded ed eeeffd d Zddded ed efd dZd ejfddZeZded ej fddZ!dZ"dZ#deeefd eeeffddZ$ej%ej&Z'de(fddZ)eZ*dEde(fddZ+d d!Z,d"d#Z-d$eefd%d&Z.dFd$eefd'd(Z/d)d*Z0 + ,dGd-ed.efd/d0Z1d1d2Z2d3d4Z3d5d6Z4d7d8Z5d9d:Z6dHdefd?d@Z7GdAdBdBe Z8GdCdDdDe8Z9dS)IN)ABCabstractmethod) signature) ModuleType)Any CoroutineDictOptionalTupleF reload_module full_pathr returncCsd|vr|ddkrtd|d|d\}}n|d}|d|}||dd}t|}|r:t||t||fS)aiGiven a full import path to a module attr, return the imported module and attr. If `reload_module` is set, the module will be reloaded using `importlib.reload`. Args: full_path: The full import path to the module and attr. reload_module: Whether to reload the module. Returns: A tuple of the imported module and attr. :zGot invalid import path "z-". An import path may have at most one colon..N)count ValueErrorsplitrfind importlib import_modulereloadgetattr)r r module_name attr_namelast_period_idxmodulerN/home/ubuntu/veenaModal/venv/lib/python3.10/site-packages/ray/_common/utils.pyimport_module_and_attrs     r cCst||ddS)aGiven a full import path to a module attr, return the imported attr. If `reload_module` is set, the module will be reloaded using `importlib.reload`. For example, the following are equivalent: MyClass = import_attr("module.submodule:MyClass") MyClass = import_attr("module.submodule.MyClass") from module.submodule import MyClass Returns: Imported attr r r)r )r r rrr import_attr3s r!c Cs~tj}|jdkr;|jdkr;z t}|dusJ|WSty:}zdt|vs*Jt WYd}~Sd}~wwt S)ajGet a running async event loop if one exists, otherwise create one. This function serves as a proxy for the deprecating get_event_loop(). It tries to get the running loop first, and if no running loop could be retrieved: - For python version <3.10: it falls back to the get_event_loop call. - For python version >= 3.10: it uses the same python implementation of _get_event_loop() at asyncio/events.py. Ideally, one should use high level APIs like asyncio.run() with python version >= 3.7, if not possible, one should create and manage the event loops explicitly.  Nzno running event loop) sys version_infomajorminorasyncioget_running_loop RuntimeErrorstrget_event_loop_policyget_event_loop) vers_infolooperrrget_or_create_event_loopCs r1 coroutinecCs&t|}t||tj|S)a1Schedule a task reliably to the event loop. This API is used when you don't want to cache the reference of `asyncio.Task`. For example, ``` get_event_loop().create_task(coroutine(*args)) ``` The above code doesn't guarantee to schedule the coroutine to the event loops When using create_task in a "fire and forget" way, we should keep the references alive for the reliable execution. This API is used to fire and forget asynchronous execution. https://docs.python.org/3/library/asyncio-task.html#creating-tasks )r1 create_task_BACKGROUND_TASKSaddadd_done_callbackdiscard)r2taskrrrrun_background_taskgs   r9zaccelerator_type:bundle options_dictcCs|dpi}d|vsd|vrtdd|vsd|vr!tdt|vr,td||d }|d }|d}|d}|d }|d urM||d<|d urU||d<|d ur_t||d<|d urg||d<|d ursd |t|<|S)zDetermine a task's resource requirements. Args: options_dict: The dictionary that contains resources requirements. Returns: A dictionary of the resource requirements for the task. resourcesCPUGPUz@The resources dictionary must not contain the key 'CPU' or 'GPU'memoryobject_store_memoryzSThe resources dictionary must not contain the key 'memory' or 'object_store_memory'zOThe resource should not include `bundle` which is reserved for Ray. resources: num_cpusnum_gpusaccelerator_typeNgMbP?)getcopyr$PLACEMENT_GROUP_BUNDLE_RESOURCE_NAMEintRESOURCE_CONSTRAINT_PREFIX)r;r<rArBr?r@rCrrrresources_from_ray_optionss>       rIlengthcCsdtjt|dS)zjGenerates random string of length consisting exclusively of - Lower-case ASCII chars - Digits )k)joinrandomchoicesRANDOM_STRING_ALPHABET)rJrrrget_random_alphanumeric_stringsrQrbackcCs>t}z||d}|jd|jWStyYdSw)aL Get the location (filename and line number) of a function caller, `back` frames up the stack. Args: back: The number of frames to go up the stack, not including this function. Returns: A string with the filename and line number of the caller. For example, "myfile.py:123". rrUNKNOWN)inspectstackfilenamelineno IndexError)rRrUframerrrget_call_locations   rZcCsldtjvr tjdStjdrdtjvrtjdStjds&tjdr0tjtjd}|St }|S)N RAY_TMPDIRlinuxTMPDIRdarwintmp) osenvironr$platform startswithpathrMseptempfile gettempdir)tempdirrrrget_user_temp_dirs   ricCstjtdS)Nray)r`rdrMrirrrrget_ray_temp_dirsrktemp_dircCs|durt}tj|dS)Nray_current_cluster)rkr`rdrM)rlrrrget_ray_address_filesrncCs>t|}tj|rzt|WdStyYdSwdSN)rnr`rdexistsremoveOSError)rl address_filerrrreset_ray_addresss  rtcCsL|d}t|dkrtdd|dd}|d}t|}t||S)z`Load a class at runtime given a full path. Example of the path: mypkg.mysubpkg.myclass rz:You need to pass a valid path like mymodule.provider_classN)rlenrrMrrr)rd class_data module_path class_strrrrr load_classs    r{+/sys/fs/cgroup/memory/memory.limit_in_bytes/sys/fs/cgroup/memory.maxmemory_limit_filenamememory_limit_filename_v2cCsd}tj|r&t|d}t|}Wdn1s wYn,tj|rRt|d}|}|rAt|}nd}Wdn1sMwYt j }|dur`t ||S|S)aReturn the total amount of system memory in bytes. Args: memory_limit_filename: The path to the file that contains the memory limit for the Docker container. Defaults to /sys/fs/cgroup/memory/memory.limit_in_bytes. memory_limit_filename_v2: The path to the file that contains the memory limit for the Docker container in cgroups v2. Defaults to /sys/fs/cgroup/memory.max. Returns: The total amount of system memory in bytes. Nr) r`rdrpopenrGreadstrip isnumericpsutilvirtual_memorytotalmin)r~r docker_limitfmax_filepsutil_memory_in_bytesrrrget_system_memory s$        rcCst|}|}|Sro)binasciihexlifydecode) identifierhex_identifierrrr binary_to_hex9s rcCs t|Sro)r unhexlify)rrrr hex_to_binary?s rc CsPz t|dWdSty'}z|jtjtjfvrnWYd}~dSd}~ww)Ni)r`chmodrrerrnoEACCESEPERM)directory_pathr0rrrtry_make_directory_sharedCsrcCs&tj|}tj|ddt|dS)NT)exist_ok)r`rd expandusermakedirsr)rrrrtry_to_create_directoryRs  rcCstt|j}t|Sro) frozensetr parameterslist)callableall_parametersrrrget_function_args[srutf-8byte_str allow_none encode_typecCs4|dur|rdSt|tstd|d||S)aMake this unicode in Python 3, otherwise leave it as bytes. Args: byte_str: The byte string to decode. allow_none: If true, then we will allow byte_str to be None in which case we will return an empty string. TODO(rkn): Remove this flag. This is only here to simplify upgrading to flatbuffers 1.10.0. encode_type: The encoding type to use for decoding. Defaults to "utf-8". Returns: A byte string in Python 2 and a unicode string in Python 3. NrKz The argument z must be a bytes object.) isinstancebytesrr)rrrrrrr`s   rc@seZdZedefddZdS) TimerBasercCst)zReturn the current time.)NotImplementedErrorselfrrrtimevszTimerBase.timeN)__name__ __module__ __qualname__rfloatrrrrrrusrc@seZdZdefddZdS)TimerrcCstSro)rrrrrr}sz Timer.timeN)rrrrrrrrrr|sr)rro)r|r})Fr):r(rrrrTr`rNstringr$rfrabcrrrtypesrtypingrrrr r rr+boolr r!AbstractEventLoopr1setr4Taskr9rHrFrIascii_lowercasedigitsrPrGrQ_PRINTED_WARNINGrZrirkrnrtr{rrrrrrrrrrrrrsn    !" /  /