o ziA @stddlZddlZddlmZddlmZmZddlmZm Z m Z m Z m Z m Z ddlmZddlmZde e e eefefde eeffd d Zde eefde eeffd d Zdde eefdedede eeffddZde eefde eeffddZde eefde eeffddZdedefddZde ee eeffdedede ee eefffddZdS) N) Namespace)asdict is_dataclass)AnyDictMappingMutableMappingOptionalUnion)Tensor)_NUMPY_AVAILABLEparamsreturncCs"t|tr t|}|duri}|S)zEnsure parameters are a dict or convert to dict if necessary. Args: params: Target to be converted to a dictionary Returns: params as a dictionary N) isinstancervarsr rU/home/ubuntu/.local/lib/python3.10/site-packages/lightning_fabric/utilities/logger.py_convert_paramss rcs(dtdtfddfdd|DS)zSanitize callable params dict, e.g. ``{'a': } -> {'a': 'function_****'}``. Args: params: Dictionary containing the hyperparameters Returns: dictionary with all callables sanitized valrcSsXt|r|jSt|r*z|}t|r|jWS|WSty)t|ddYSw|S)N__name__)inspectisclassrcallable Exceptiongetattr)r_valrrr_sanitize_callable9s  z5_sanitize_callable_params.._sanitize_callablecsi|] \}}||qSrr).0keyrrrr Isz-_sanitize_callable_params..)ritemsrrr r_sanitize_callable_params.s r#/ delimiter parent_keycCsi}|D]>\}}|r||t|nt|}t|r&t|ts&t|}n t|tr/t|}t|tr@i|t |||d}q|||<q|S)aFlatten hierarchical dict, e.g. ``{'a': {'b': 'c'}} -> {'a/b': 'c'}``. Args: params: Dictionary containing the hyperparameters delimiter: Delimiter to express the hierarchy. Defaults to ``'/'``. Returns: Flattened dict. Examples: >>> _flatten_dict({'a': {'b': 'c'}}) {'a/b': 'c'} >>> _flatten_dict({'a': {'b': 123}}) {'a/b': 123} >>> _flatten_dict({5: {'a': 123}}) {'5/a': 123} )r'r&) r"strrrtyperrrr _flatten_dict)r r&r'resultkvnew_keyrrrr*Ls    r*cCsn|D]2}trddl}t|||j|j|jfr||||<t||tt t t t fvr4t ||||<q|S)aReturns params with non-primitvies converted to strings for logging. >>> import torch >>> params = {"float": 0.3, ... "int": 1, ... "string": "abc", ... "bool": True, ... "list": [1, 2, 3], ... "namespace": Namespace(foo=3), ... "layer": torch.nn.BatchNorm1d} >>> import pprint >>> pprint.pprint(_sanitize_params(params)) # doctest: +NORMALIZE_WHITESPACE {'bool': True, 'float': 0.3, 'int': 1, 'layer': "", 'list': '[1, 2, 3]', 'namespace': 'Namespace(foo=3)', 'string': 'abc'} rN) r numpyrbool_integerfloatingitemr)boolintfloatr(r )r r,nprrr_sanitize_paramsnsr8cCsdd|DS)z5Convert non-serializable objects in params to string.cSs&i|]\}}|t|st|n|qSr)_is_json_serializabler(rr,r-rrrr!s&z._convert_json_serializable..r"rrrr_convert_json_serializablesr<valuec CsL|dust|ttttttfrdSzt|WdSt t fy%YdSw)z/Test whether a variable can be encoded as json.NTF) rr4r5r6r(listdictjsondumps TypeError OverflowError)r=rrrr9s r9metricsprefix separatorcs s|Sfdd|DS)alInsert prefix before each key in a dict, separated by the separator. Args: metrics: Dictionary with metric names as keys and measured quantities as values prefix: Prefix to insert before each key separator: Separates prefix and original key name Returns: Dictionary with prefix and separator inserted before each key cs"i|] \}}||qSrrr:rErFrrr!s"z_add_prefix..r;)rDrErFrrGr _add_prefixsrH)r$r%)rr@argparser dataclassesrrtypingrrrrr r torchr "lightning_fabric.utilities.importsr r(rr#r*r8r<r4r9r6rHrrrrs,    .","""!