o …wÖiúBã@s´ddlZddlZddlZddlZddlZddlmZddlm Z ddl m Z m Z ddl mZddlmZmZddlmZddlmZd d gZGd d „d ejƒZGd d „d ed ZdS)éN)Úcontextmanager)Ú MemoryHandler)Ú(NEMO_ENV_VARNAME_REDIRECT_LOGS_TO_STDERRÚNEMO_ENV_VARNAME_TESTING)Ú get_envbool)ÚBaseNeMoFormatterÚDebugNeMoFormatter)Úis_global_rank_zero)Ú SingletonÚLoggerÚLogModec@seZdZdZdZdS)r réN)Ú__name__Ú __module__Ú __qualname__ÚEACHÚONCE©rrúT/home/ubuntu/sommelier/.venv/lib/python3.10/site-packages/nemo/utils/nemo_logging.pyr !sc@s<eZdZejZejZejZejZejZej Z dddddddœZ d9d d „Z d9d d „Z d d„Z efdd„Zefdd„Zdd„Zdd„Zdd„Zdd„Zdd„Zdd„Zedd „ƒZed!d"„ƒZed#d$„ƒZd%d&„Zd'd(„Zd:d*d+„Zd,d-„Zej d.œd/d0„Z!ej d.œd1d2„Z"ej d.œd3d4„Z#ej d.œd5d6„Z$ej d.œd7d8„Z%d)S);r ÚNOTSETÚDEBUGÚINFOÚWARNINGÚERRORÚCRITICAL)ré ééé(é2TcCsJd|_t ¡|_tƒ|_d|_| |¡tƒ|_ t ƒr d|_ dSd|_ dS)NrÚUNK) Ú_loggerÚ threadingÚLockÚ _logger_lockÚdictÚ _handlersÚold_warnings_showwarningÚ_define_loggerÚsetÚ once_loggedr Úrank)ÚselfÚcapture_warningsrrrÚ__init__Cs  zLogger.__init__c s‚ˆjdurˆjSˆj¨zˆt d¡ˆ_ˆ ¡ttdƒr3t ¡‰‡‡fdd„}t |¡ˆj t dnt ƒr:ˆ  ¡t ƒrbt dƒˆj d<ˆj d d d „¡t}ˆj d |ƒ¡ˆj ˆj d¡t dƒˆj d <t}ˆj d  |ƒ¡ˆj ˆj d ¡Wtj}ttdƒr‰tj}ˆj|d ˆ |¡ntj}ttdƒr tj}ˆj|d ˆ |¡wWdƒn1s¶wYdˆj_dS) z9Creates the logger if not already created. Called in initNÚ nemo_loggerFcsˆ|i|¤Ž}ˆj|_|S©N)r+)ÚargsÚkwargsÚrecord©Ú old_factoryr,rrÚrecord_factory^sz-Logger._define_logger..record_factory©Ú formatteréÿÿÿÿÚ memory_errcSó |jtjkSr0©ÚlevelnoÚ_loggingr©r3rrrÚmó z'Logger._define_logger..Ú memory_all)Úverbosity_level)r!r$r>Ú getLoggerÚremove_stream_handlersrrÚgetLogRecordFactoryÚsetLogRecordFactoryÚadd_stream_handlersrr rr&Ú addFilterrÚ setFormatterÚ addHandlerr rrÚ set_verbosityÚcaptureWarningsÚ propagate)r,r-r6r8Úlevelrr4rr(NsF       ü  Ù )zLogger._define_loggercCsz|jdur tdƒ‚z|j |jd¡|jd=Wn ty!Ynwz|j |jd¡|jd=WdSty<YdSw)zDRemoves StreamHandler that log to stdout and stderr from the logger.Nú:Impossible to set handlers if the Logger is not predefinedÚ stream_stdoutÚ stream_stderr)r!Ú RuntimeErrorÚ removeHandlerr&ÚKeyError©r,rrrrE€s   ÿ ÿzLogger.remove_stream_handlerscCsà|jdur tdƒ‚ttdƒrt tj¡|jd<n&t tj ¡|jd<|jd  dd„¡t tj¡|jd<|jd  dd„¡|jd  |ƒ¡|j  |jd¡z|jd  |ƒ¡|j  |jd¡WdSt yoYdSw) a%Add StreamHandler that log to stdout and stderr to the logger. INFO and lower logs are streamed to stdout while WARNING and higher are streamed to stderr. If the NEMO_ENV_VARNAME_REDIRECT_LOGS_TO_STDERR environment variable is set, all logs are sent to stderr instead. NrPFrQcSs |jtjkSr0r<r?rrrr@¡rAz,Logger.add_stream_handlers..rRcSr;r0r<r?rrrr@¤rA)r!rSrrr>Ú StreamHandlerÚsysÚstderrr&ÚstdoutrIrJrKrU©r,r8rrrrH“s   ÿzLogger.add_stream_handlerscCs| ¡|j|ddS)z"Removes then adds stream handlers.r7N)rErHr[rrrÚreset_stream_handler¯szLogger.reset_stream_handlercCsŒ|jdur tdƒ‚t |¡|jd<t}|jd |ƒ¡|j |jd¡|j dd¡rD|jd  |jd¡|jd  ¡|jd=dSdS)zæAdd a FileHandler to logger that logs all messages to a file. If the logger had a MemoryHandler at self._handlers["memory_all"], those buffered messages are flushed to the new file, and the MemoryHandler is closed.NrPÚfilerB) r!rSr>Ú FileHandlerr&rrJrKÚgetÚ setTargetÚclose©r,Úlog_filer8rrrÚadd_file_handler´s  ýzLogger.add_file_handlercCs |jdur tdƒ‚t |¡|jd<|jd dd„¡t}|jd |ƒ¡|j |jd¡|j  dd¡rN|jd  |jd¡|jd  ¡|jd=dSdS)zùAdd a FileHandler to logger that logs all WARNING and higher messages to a file. If the logger had a MemoryHandler at self._handlers["memory_err"], those buffered messages are flushed to the new file, and the MemoryHandler is closed.NrPÚfile_errcSr;r0r<r?rrrr@ÍrAz-Logger.add_err_file_handler..r:) r!rSr>r^r&rIrrJrKr_r`rarbrrrÚadd_err_file_handlerÅs  ýzLogger.add_err_file_handlercCs|jdur |j ¡SdS)z0Return how much logging output will be produced.N)r!ÚgetEffectiveLevelrVrrrrgØs  ÿzLogger.getEffectiveLevelcCs| ¡S)zSee getEffectiveLevel)rgrVrrrÚ get_verbosityÝszLogger.get_verbositycCs6|jdur|j |¡|jjD] }| |¡qdSdS)z4Sets the threshold for what messages will be logged.N)r!ÚsetLevelÚhandlers)r,rCÚhandlerrrrriás    üzLogger.setLevelcCs| |¡dS)z See setLevelN)ri)r,rCrrrrLészLogger.set_verbosityccó<|jduršzmz7|jdj}|durt‚|jd ¡z|jd ¡||jd_W|jd ¡n|jd ¡w|VWn ttfyKtdƒ‚wW|jd ¡z|jd ¡||jd_W|jd ¡dS|jd ¡w|jd ¡z|jd ¡||jd_W|jd ¡w|jd ¡wtdƒ‚)zPSends messages that should log to stderr to stream instead. Useful for unittestsNrRú>Impossible to patch logging handlers if handler does not exist© r!r&ÚstreamÚ ValueErrorÚacquireÚflushÚreleaserUrS©r,roÚ old_streamrrrÚpatch_stderr_handleríó6€    ÿÿ"û zLogger.patch_stderr_handlerccrl)zPSends messages that should log to stdout to stream instead. Useful for unittestsNrQrmrnrtrrrÚpatch_stdout_handler rwzLogger.patch_stdout_handlerc csR|jdur!| ¡}z| |¡dVW| |¡dS| |¡wzdVWdSw)z@Sets the a temporary threshold for what messages will be logged.N)r!rhrL)r,rCÚ old_verbosityrrrÚtemp_verbosity-s€  zLogger.temp_verbositycCsX|jdur&|r|jdurtj|_|jt_dS|s(|jdur*|jt_d|_dSdSdSdS)zÏ If capture is true, redirect all warnings to the logging package. If capture is False, ensure that warnings are not redirected to logging but to their original destinations. N)r!r'ÚwarningsÚ showwarningÚ _showwarning)r,ÚcapturerrrrMCs   özLogger.captureWarningscCs:ddlm}|D]\}}}}}||kr|dkrdSqdS)Nr)ÚfiltersÚignoreTF)r{r)r,ÚcategoryrÚactionÚmsgÚcatÚmodÚlnrrrÚ_warning_is_ignoredVs €zLogger._warning_is_ignoredNcCs0t |||||¡}| |¡rdS| d|¡dS)z¾ Implementation of showwarnings which redirects to logging. It will call warnings.formatwarning and will log the resulting string with level logging.WARNING. Nz%s)r{Ú formatwarningr‡Úwarning)r,ÚmessagerÚfilenameÚlinenor]ÚlineÚsrrrr}`s zLogger._showwarningcCs<d}|tjkr||d…|jvrdS|j ||d…¡dS)Né TF)r rr*Úadd)r,rƒÚmodeÚ PREFIX_LENrrrÚ _logged_onceks  zLogger._logged_once)r‘cOóN|jdur!|j tj¡r#| ||¡s%|jjtj||fi|¤ŽdSdSdSdS)zð Log 'msg % args' with severity 'DEBUG'. To pass exception information, use the keyword argument exc_info with a true value, e.g. logger.debug("Houston, we have a %s", "thorny problem", exc_info=1) N)r!Ú isEnabledForr rr“Ú_log©r,rƒr‘r1r2rrrÚdebugsó$  ÿz Logger.debugcOr”)zó Log 'msg % args' with severity 'INFO'. To pass exception information, use the keyword argument exc_info with a true value, e.g. logger.info("Houston, we have a %s", "interesting problem", exc_info=1) N)r!r•r rr“r–r—rrrÚinfor™z Logger.infocOr”)zö Log 'msg % args' with severity 'WARNING'. To pass exception information, use the keyword argument exc_info with a true value, e.g. logger.warning("Houston, we have a %s", "bit of a problem", exc_info=1) N)r!r•r rr“r–r—rrrr‰‹r™zLogger.warningcOr”)zï Log 'msg % args' with severity 'ERROR'. To pass exception information, use the keyword argument exc_info with a true value, e.g. logger.error("Houston, we have a %s", "major problem", exc_info=1) N)r!r•r rr“r–r—rrrÚerror—r™z Logger.errorcOr”)zö Log 'msg % args' with severity 'CRITICAL'. To pass exception information, use the keyword argument exc_info with a true value, e.g. logger.critical("Houston, we have a %s", "major disaster", exc_info=1) N)r!r•r rr“r–r—rrrÚcritical£s ÿ þ üzLogger.critical)T)NN)&rrrr>rrrrrrÚ _level_namesr.r(rErrHr\rdrfrgrhrirLrrvrxrzrMr‡r}r“r rr˜ršr‰r›rœrrrrr &sPú 2           )Ú metaclass)ÚenumÚloggingr>rXr"r{Ú contextlibrÚlogging.handlersrÚnemo.constantsrrÚnemo.utils.env_var_parsingrÚnemo.utils.formatters.baserrÚnemo.utils.get_rankr Únemo.utils.metaclassesr Ú__all__ÚIntEnumr r rrrrÚs