o Y۷i-@sddlZddlZddlZddlmZddlmZddlmZddl m Z ddl m Z ddl mZGdddZed gd Zd d ZGd ddZedddgZGdddeZdS)N) namedtuple)Sequence)contextmanager)cached_property)configc@s.eZdZdZdgZddZddZddZd S) RecordLLVMPassTimingsz9A helper context manager to track LLVM pass timings. _datacCstd|S)z)Enables the pass timing in LLVM. T)llvmset_time_passesselfr R/home/ubuntu/vllm_env/lib/python3.10/site-packages/numba/misc/llvm_pass_timings.py __enter__s zRecordLLVMPassTimings.__enter__cCst|_tddS)z2Reset timings and save report internally. FN)r report_and_reset_timingsrr )r exc_valexc_typeexc_tbr r r__exit__s  zRecordLLVMPassTimings.__exit__cC t|jS)ztRetrieve timing data for processing. Returns ------- timings: ProcessedPassTimings )ProcessedPassTimingsrr r r rget!s zRecordLLVMPassTimings.getN)__name__ __module__ __qualname____doc__ __slots__rrrr r r rrs  rPassTimingRecord) user_time user_percent system_timesystem_percentuser_system_timeuser_system_percent wall_time wall_percent pass_name instructioncs\|djdks JfddfdddDtdd |}fd d }tt||S) zAdjust timing records because of truncated information. Details: The percent information can be used to improve the timing information. Returns ------- res: List[PassTimingRecord] Totalcs4|d|dtfdd}|S)N_time_percentcs$}||d}||<|S)z'Compute percent x total_time = adjustedg{Gz?r )dtotaladjusted) percent_attr time_attr time_getter total_recr radjustNsz6_adjust_timings..make_adjuster..adjust)operator attrgetter)attrr3)r2)r/r0r1r make_adjusterIs   z&_adjust_timings..make_adjustercsg|]}|qSr r ).0x)r7r r Xsz#_adjust_timings..)usersystem user_systemwallcS|SN)_asdictr9r r r]sz!_adjust_timings..cs D]}||}qtdi|S)Nr )r)r,fn)adj_fnsr rchained_s z _adjust_timings..chained)r&maplist)recordsdictsrFr )rEr7r2r_adjust_timings<s    rKc@s^eZdZdZddZddZddZdd Zd d Zd d Z dddZ e ddZ ddZ dS)rzA class for processing raw timing report from LLVM. The processing is done lazily so we don't waste time processing unused timing information. cCs ||_dSr@ _raw_data)r raw_datar r r__init__p zProcessedPassTimings.__init__cCrr@)boolrMr r r r__bool__srPzProcessedPassTimings.__bool__cC|jS)zWReturns the raw string data. Returns ------- res: str rLr r r r get_raw_datavz!ProcessedPassTimings.get_raw_datacCs|djS)zhCompute the total time spend in all passes. Returns ------- res: float r() list_recordsr$r r r rget_total_timesz#ProcessedPassTimings.get_total_timecCrS)z{Get the processed data for the timing report. Returns ------- res: List[PassTimingRecord] ) _processedr r r rrVrUz!ProcessedPassTimings.list_recordscCs(|}td}t||dd|S)aReturns the top(n) most time-consuming (by wall-time) passes. Parameters ---------- n: int This limits the maximum number of items to show. This function will show the ``n`` most time-consuming passes. Returns ------- res: List[PassTimingRecord] Returns the top(n) most time-consuming passes in descending order. r$Nr()rVr4r5heapqnlargest)r nrIkeyr r rlist_tops zProcessedPassTimings.list_toprcsvgd|fdd}|d|dd|d||D]}|d|jdd |jd d |jq!d S) aReturn a string summarizing the timing information. Parameters ---------- topn: int; optional This limits the maximum number of items to show. This function will show the ``topn`` most time-consuming passes. indent: int; optional Set the indentation level. Defaults to 0 for no indentation. Returns ------- res: str  cs|dSr@)append)argbufprefixr rapsz(ProcessedPassTimings.summary..apzTotal .4fsz Top timings:z zs (5z%)  )rWr]r$r%r&join)r topnindentrepr rbrsummarys& zProcessedPassTimings.summarycCr?)ztA cached property for lazily processing the data and returning it. See ``_process()`` for details. )_processr r r rrXszProcessedPassTimings._processedcCsdd}t||j}t|S)zParses the raw string data from LLVM timing report and attempts to improve the data by recomputing the times (See `_adjust_timings()``). c3s|}d}d|d}t|}dddddd d |D]}t||}|r7td |}fd d |D}nq|dd ks@Jg} d} d} |ddD]&} | dkrW| | 7} qL| | d| | d| d| d| d7} qLi} tjD]} | | vr| d krd| | <qx| d7} |D]8}t| |}|durt| }ddt | |D}| | |d}tdd |i|}|V|j dkrnqd |}|rtd|dS)zwA generator that parses the raw_data line-by-line to extract timing information for each pass. z [a-zA-Z+ ]+z(?:\s*-+z-+)+r;r<r=r>r'r&)z User Timez System Timez User+Systemz Wall TimeInstrNamez[a-zA-Z][a-zA-Z+ ]+csg|]}|qSr )strip)r8k header_mapr rr:sz@ProcessedPassTimings._process..parse..r(z\s*((?:[0-9]+\.)?[0-9]+)Nr*r+z\s+(?:z\s*\(z%\)|-+)z\s*(.*)cSs&i|]\}}||durt|ndqS)Nrw)float)r8rsvr r r sz@ProcessedPassTimings._process..parse..r)riz'unexpected text after parser finished: r ) splitlinesiterrematchfindallr`r_fieldsrHgroupszipupdater&rj ValueError)rNlines colheadermulticolheaders line_iterlnm raw_headersheadersattrsr[patrsmissingdatar&rec remainingr rtrparsesv          z,ProcessedPassTimings._process..parse)rHrMrK)r rrIr r rrosFzProcessedPassTimings._processN)r^r)rrrrrOrRrTrWrVr]rnrrXror r r rris     r NamedTimingsnametimingsc@sjeZdZdZddZeddZddZdd Zd d Z e d d Z dddZ ddZ ddZddZdS)PassTimingsCollectionzA collection of pass timings. This class implements the ``Sequence`` protocol for accessing the individual timing records. cCs||_g|_dSr@)_name_records)r rr r rrO s zPassTimingsCollection.__init__ccs^tjr*t }dVWdn1swY|}|r(|||dSdSdVdS)aRecord new timings and append to this collection. Note: this is mainly for internal use inside the compiler pipeline. See also ``RecordLLVMPassTimings`` Parameters ---------- name: str Name for the records. N)rLLVM_PASS_TIMINGSrr_append)r rrrr r rrecord$s  zPassTimingsCollection.recordcCs|jt||dS)zAppend timing records Parameters ---------- name: str Name for the records. timings: ProcessedPassTimings the timing records. N)rr`r)r rrr r rr=s zPassTimingsCollection._appendcCs|jr tdd|jDSdS)zComputes the sum of the total time across all contained timings. Returns ------- res: float or None Returns the total number of seconds or None if no timings were recorded css|]}|jVqdSr@rrW)r8rr r r Ssz7PassTimingsCollection.get_total_time..N)rsumr r r rrWIs z$PassTimingsCollection.get_total_timecCst|jddddS)zReturns the timings in descending order of total time duration. Returns ------- res: List[ProcessedPassTimings] cSs |jSr@rrBr r rrC_s z:PassTimingsCollection.list_longest_first..T)r\reverse)sortedrr r r rlist_longest_firstWsz(PassTimingsCollection.list_longest_firstcCs|j S)z rr r r ris_emptybszPassTimingsCollection.is_emptyr^cCs|jrdSg}|j}|d|j|}|d|dt|jD]+\}}|d|d|j|j|d}|d|d d ||jj|d d q#d |S)aReturn a string representing the summary of the timings. Parameters ---------- topn: int; optional, default=5. This limits the maximum number of items to show. This function will show the ``topn`` most time-consuming passes. Returns ------- res: str See also ``ProcessedPassTimings.summary()`` zNo pass timings were recordedzPrinting pass timings for z Total time: rfz== #r_dz Percent: z.1f%)rkrlri) rr`rrW enumeraterrrrnrj)r rkrcre overall_timeirpercentr r rrnhs zPassTimingsCollection.summarycCs |j|S)zGet the i-th timing record. Returns ------- res: (name, timings) A named tuple with two fields: - name: str - timings: ProcessedPassTimings r)r rr r r __getitem__s z!PassTimingsCollection.__getitem__cCr)z#Length of this collection. )lenrr r r r__len__s zPassTimingsCollection.__len__cCr?r@)rnr r r r__str__szPassTimingsCollection.__str__N)r^)rrrrrOrrrrWrpropertyrrnrrrr r r rrs     r)r}r4rY collectionsrcollections.abcr contextlibr functoolsr numba.corerllvmlite.bindingbindingr rrrKrrrr r r rs&      -.