o bi!1@sddlZddlZddlZddlZddlZddlZddlmZddlmZddl m Z e e Z dZdZdZde eeffd d Zd efd d Zd efddZGdddZGdddZdS)N)datetime)Path)Unionz#sudo chown root: `which {profiler}`z'sudo chown root:root `which {profiler}`aB Note that this command requires `{profiler}` to be installed with root permissions. You can install `{profiler}` and give it root permissions as follows: $ pip install {profiler} $ {set_chown_command} $ sudo chmod u+s `which {profiler}` Alternatively, you can start Ray with passwordless sudo / root permissions. stringcCst|tr |dS|S)Nzutf-8) isinstancebytesdecode)rr b/home/ubuntu/.local/lib/python3.10/site-packages/ray/dashboard/modules/reporter/profile_manager.pyrs  rreturnc Csnt|}d}d|vr$tjdkrtj|dntj|d}tj||d}d|d|dt|d t|d S) N permissiondarwin)profiler)rset_chown_commandzFailed to execute `z`. z === stderr === z === stdout ===  )rlowersysplatformDARWIN_SET_CHOWN_CMDformatLINUX_SET_CHOWN_CMD"PROFILER_PERMISSIONS_ERROR_MESSAGE)cmdrstdoutstderr stderr_str extra_messagerr r r _format_failed_profiler_command"s"   rcsVztjdddtjtjdIdH}Wn tyYdSw|IdH\}}|jdkS)Nsudo-ntruerrFr)asynciocreate_subprocess_exec subprocessPIPEFileNotFoundError communicate returncode)process_r r r _can_passwordless_sudo>s  r,c @sXeZdZdefddZddededeeffdd Z dded ededeeffd dZ dS)CpuProfilingManagerprofile_dir_pathcCs"t||_|jjddd|_dS)NTexist_okzpy-spyrr.mkdir profiler_nameselfr.r r r __init__Os  zCpuProfilingManager.__init__Fpidnativer cst|j}|dur dS|ddt|g}tjdkr!|r!|dtIdHr-ddg|}tj |t j t j d IdH}| IdH\}}|j d krSd t||j||fSd t|fS) a Capture and dump a trace for a specified process. Args: pid: The process ID (PID) of the target process for trace capture. native (bool, optional): If True, includes native (C/C++) stack frames. Default is False. Returns: Tuple[bool, str]: A tuple containing a boolean indicating the success of the trace capture operation and a string with the trace data or an error message. NFz*Failed to execute: py-spy is not installeddump-plinux--nativerr r"rFT)shutilwhichr3strrrappendr,r#r$r%r&r(r)rr)r5r7r8pyspyrr*rrr r r trace_dumpTs(       zCpuProfilingManager.trace_dump flamegraphdurationc st|j}|dur dS|dvrdd|ddfS|dkr"d }nd }|j|d |d |}|d d|dt|dt|d|g }tjdkrM|rM|dtIdHrYddg|}t j |t j t j dIdH} | IdH\} } | jdkrdt||j| | fSdt|dfS)a Perform CPU profiling on a specified process. Args: pid: The process ID (PID) of the target process to be profiled. format (str, optional): The format of the CPU profile output. Default is "flamegraph". duration (float, optional): The duration of the profiling session in seconds. Default is 5 seconds. native (bool, optional): If True, includes native (C/C++) stack frames. Default is False. Returns: Tuple[bool, str]: A tuple containing a boolean indicating the success of the profiling operation and a string with the profile data or an error message. Nr9)rDraw speedscopeFz"Failed to execute: Invalid format z, z%must be [flamegraph, raw, speedscope]rDsvgtxtr+z_cpu_profiling.record-or;z-d-fr<r=rr r"rTrb)r>r?r3r.r@rrrAr,r#r$r%r&r(r)ropenread) r5r7rrFr8rB extensionprofile_file_pathrr*rrr r r cpu_profileysR       zCpuProfilingManager.cpu_profileNF)rDrEF) __name__ __module__ __qualname__r@r6intboolrCfloatrSr r r r r-Ns&r-c @seZdZdefddZ  ddededed ed eeff d d Z   dded ededed eeff ddZ ddeded eeffddZ dS)MemoryProfilingManagerr.cCs&t|d|_|jjddd|_dS)NmemrayTr/r1r4r r r r6s zMemoryProfilingManager.__init__rDFr7profiler_filenamerleaksr cst|j}|dur dS|j|}t|s dd|dfStj|\}}|j|d} |dkr<|dd| d g} n|d krH|d d| d g} ndd |d fS|rW| d | |t j | t j t j dIdH} | IdH\} } | jdkrdt| |j| | fSdt| dfS)a Convert the Memray profile result to specified format. Args: pid: The process ID (PID) associated with the profiling operation. profiler_filename: The filename of the profiler output to be processed. format (str, optional): The format of the profile result. Default is "flamegraph". leaks (bool, optional): If True, include memory leak information in the profile result. Returns: Tuple[bool, str]: A tuple containing a boolean indicating the success of the operation and a string with the processed profile result or an error message. NF*Failed to execute: memray is not installedFzFailed to execute: process z has not been profiledz.htmlrDrLrMtablez'Failed to execute: Report with format: z is not supportedz--leaksr"rTrN)r>r?r3r.ris_fileospathsplitextrAr#r$r%r&r(r)rrOrP)r5r7r]rr^r\rRr3r+profile_visualize_path visualize_cmdr*rrr r r get_profile_resultsP        z)MemoryProfilingManager.get_profile_resultr8trace_python_allocatorsverbosec st|j}|dur dStd}|d|d}|j|}|dt|d|g} |r1| d|r8| d |r?| d t IdHrKd d g| } t j | t j t j d IdH} | IdH\} } | jdkrrddt| |j| | fSd|d|fS)a Attach a Memray profiler to a specified process. Args: pid: The process ID (PID) of the target process which the profiler attached to. native (bool, optional): If True, includes native (C/C++) stack frames. Default is False. trace_python_allocators (bool, optional): If True, includes Python stack frames. Default is False. verbose (bool, optional): If True, enables verbose output. Default is False. Returns: Tuple[bool, str]: A tuple containing a boolean indicating the success of the operation and a string of a sucess message or an error message. N)FNr`z %Y%m%d%H%M%S_memory_profiling_z.binattachrLr=z--trace-python-allocators --verboserr r"rFTz$Success attaching memray to process )r>r?r3rnowstrftimer.r@rAr,r#r$r%r&r(r)r) r5r7r8rirjr\ timestampr]rRrr*rrr r r attach_profiler sB          z&MemoryProfilingManager.attach_profilercst|j}|dur dS|dg}|r|d|t|tIdHr+ddg|}tj|tj tj dIdH}| IdH\}}|j dkrQd t ||j||fSd d |fS) a Detach a profiler from a specified process. Args: pid: The process ID (PID) of the target process the profiler detached from. verbose (bool, optional): If True, enables verbose output. Default is False. Returns: Tuple[bool, str]: A tuple containing a boolean indicating the success of the operation and a string of a success message or an error message. Nr_detachrmrr r"rFTz&Success detaching memray from process ) r>r?r3rAr@r,r#r$r%r&r(r)r)r5r7rjr\rr*rrr r r detach_profilerLs*      z&MemoryProfilingManager.detach_profilerN)rDF)FFFrT) rUrVrWr@r6rXrYrhrqrsr r r r r[sJ  L Cr[)r#loggingrcr>r%rrpathlibrtypingr getLoggerrUloggerrrrr@rrrrYr,r-r[r r r r s$     o