o wi.@sdZddlZddlZddlmZddlmZddlmZm Z m Z m Z m Z ddl mZmZmZddlmZddlmZdd lmZdd lmZeeZGd d d eZGd ddeZGdddeZdS)Configuration for OneLogger.N)Enum)Path)CallableDictLiteralOptionalUnion) BaseModel ConfigDictmodel_validator)Self)TelemetryConfig)AttributeValue)evaluate_valuec@seZdZdZ dZ dZdS)OneLoggerErrorHandlingStrategyaEnum for the error handling strategy for OneLogger. This enum determines what happens when OneLogger encounters a fatal error (e.g., an exception in the instrumentation code or a problem with the OneLogger state). This does NOT affect handling of errors occuring when communicating with the telemetry backends (i.e., exporter failures, which are handled by the Recorder). Rather, this is about handling user errors when configuring OneLogger or bugs in telemetry code (e.g., assertion/invariant violations or hitting an inconsistent state). Our recommendation is to use PROPAGATE_EXCEPTIONS for development scenarios where you want maximum visibility into errors, or DISABLE_QUIETLY_AND_REPORT_METRIC_ERROR for production scenarios where training should continue even if logging fails. Note: If you don't explicitly specify a strategy, OneLogger will automatically apply smart defaults: - Enabled ranks (enable_for_current_rank=True): PROPAGATE_EXCEPTIONS (for error visibility) - Disabled ranks (enable_for_current_rank=False): DISABLE_QUIETLY_AND_REPORT_METRIC_ERROR (for safety) Read the docstrings for DefaultRecorder for more details on how errors from exporters (e.g., communication errors with telemetry backends) are handled when using that recorder. propagate_exceptions'disable_quietly_and_report_metric_errorN)__name__ __module__ __qualname____doc__PROPAGATE_EXCEPTIONS'DISABLE_QUIETLY_AND_REPORT_METRIC_ERRORrrU/home/ubuntu/sommelier/.venv/lib/python3.10/site-packages/nv_one_logger/api/config.pyr!s rc@sneZdZUdZdZeded<dZeed<dZ e e efed<d Z e e efed <e d d d efddZdS) LoggerConfigz=Configuration for how OneLogger logs its messages and errors.INFODEBUGrWARNINGERRORCRITICAL log_levelz&%(name)s - %(levelname)s - %(message)s log_formatz onelogger.loglog_file_path_for_infoz onelogger.errlog_file_path_for_erraftermodereturncCs$|jdvrtddd|j|S)zValidate the logger config.>rrr!r r"zlog_level must be one of rz, got )r# ValueErrorselfrrrvalidate_configSs zLoggerConfig.validate_configN)rrrrr#r__annotations__r$strr%r rr&r r r.rrrrrFs  rc@s8eZdZUdZeddZeed<ee e ge ffed<e de fddZ eee geffed <e defd d Z d Zeee geffed <e defddZdZeeeefed<ejZeed<dZeed<eZeed<dZeeefed<dZeeed<eddeddZ eddde!fddZ"dS)OneLoggerConfigrT)arbitrary_types_allowedapplication_nameworld_size_or_fnr*cC t|jS)z>Number of processes participating in the telemetry collection.)rr4r,rrr world_sizeos zOneLoggerConfig.world_sizesession_tag_or_fncCr5)zaGet the session tag. Returns: str: The evaluated session tag value. )rr7r,rrr session_tagy zOneLoggerConfig.session_tagFis_baseline_run_or_fncCr5)znGet the baseline run flag. Returns: bool: The evaluated baseline run flag value. )rr:r,rrris_baseline_runr9zOneLoggerConfig.is_baseline_runNcustom_metadataerror_handling_strategyenable_for_current_rank logger_configz1.0.0summary_data_schema_versiontelemetry_configbeforer(cCst|trCd|v}|sC|ddsCttjdd}td|dtj |d<d|vr0i|d<t|dtrCd |dvrCd |dd <|S) a Apply defaults for error handling strategy based on rank enablement. This applies production-safe defaults by automatically using quiet error handling for disabled ranks when the user hasn't explicitly specified an error handling strategy. r=r>TRANKrzeOneLogger: Setting error_handling_strategy to DISABLE_QUIETLY_AND_REPORT_METRIC_ERROR for rank (rank=zY) with OneLogger disabled. To override: explicitly set error_handling_strategy parameter.r?r#r") isinstancedictgetintosenvironloggerwarningrr)clsdatauser_set_error_handlingrankrrrapply_error_handling_defaultss   z-OneLoggerConfig.apply_error_handling_defaultsr'cCsX|jr|js td|jdkrtd|jdur*|jD] }|s)tdq|S)aValidate the OneLogger configuration. This validator ensures that: - application_name is not empty - world_size is set to a positive value - custom_metadata keys are valid strings (if provided) - telemetry_config implements the TelemetryConfig protocol (if provided) Returns: OneLoggerConfig: The validated configuration. Raises: ValueError: If the configuration is invalid. z3application_name cannot be empty or whitespace-onlyrz*world_size must be set to a positive valueNz.custom_metadata keys must be non-empty strings)r3stripr+r6r<keys)r-keyrrrr.s  zOneLoggerConfig.validate_config)#rrrrr model_configr0r/r rGrpropertyr6r8r:boolr;r<rrrrrr=r>rr?r@rArr classmethodrPr r.rrrrr1[s0       r1)rloggingrHenumrpathlibrtypingrrrrr pydanticr r r typing_extensionsr "nv_one_logger.api.telemetry_configrnv_one_logger.core.attributesr!nv_one_logger.core.internal.utilsr getLoggerrrJrrr1rrrrs        %