o `۷i(@sddlmZmZmZddlmZddlmZmZm Z e  ddeeee fde fdd Z eddeee efde fd d Z ed dZ edddZdS))CallableOptionalUnion) DeveloperAPI)try_import_jax try_import_tftry_import_torchNtfname frameworkc CsXt|r|St|tr|n|}|dkrP|dvrdSt\}}t||d}|dur,|S|dvr3|jS|dkr:|jS|dkrA|jS|dkrH|j S|dkrO|j SnT|d kr|dvrZdSt \}}|dvrg|j j S|dkro|j jS|dkrw|j jS|dkr|j jSn$|d vsJd ||dvrdSt\}}} t|j |d}|dur|Std ||) aReturns a framework specific activation function, given a name string. Args: name: One of "relu" (default), "tanh", "elu", "swish" (or "silu", which is the same), or "linear" (same as None). framework: One of "jax", "tf|tf2" or "torch". Returns: A framework-specific activtion function. e.g. tf.nn.tanh or torch.nn.ReLU. None if name in ["linear", None]. Raises: ValueError: If name is an unknown activation function. torch)linearNN)swishsilurelutanhelusoftmaxjaxr tf2Unsupported framework `{}`!)Unknown activation ({}) for framework={}!)callable isinstancestrlowerrgetattrSiLUReLUTanhELUSoftmaxrnnrr hard_tanhrformatr ValueError) r r name_lower_r#fnrtf1r tfvr,L/home/ubuntu/vllm_env/lib/python3.10/site-packages/ray/rllib/models/utils.pyget_activation_fns\     r.r cCst|s|dur |S|dkr@t|tr|n|}t\}}|ds+td|dt|j|d}|dur8|Std|d|dkr`t \}}}t|j j |d}|durX|Std |d dS) aReturns the framework-specific initializer class or function. This function relies fully on the specified initializer classes and functions in the frameworks `torch` and `tf2` (see for `torch` https://pytorch.org/docs/stable/nn.init.html and for `tf2` see https://www.tensorflow.org/api_docs/python/tf/keras/initializers). Note, for framework `torch` the in-place initializers are needed, i.e. names should end with an underscore `_`, e.g. `glorot_uniform_`. Args: name: Name of the initializer class or function in one of the two supported frameworks, i.e. `torch` or `tf2`. framework: The framework string, either `torch or `tf2`. Returns: A framework-specific function or class defining an initializer to be used for network initialization, Raises: `ValueError` if the `name` is neither class or function in the specified `framework`. Raises also a `ValueError`, if `name` does not define an in-place initializer for framework `torch`. Nr r(zNot an in-place initializer: Torch weight initializers need to be provided as their in-place version, i.e. + '_'. See https://pytorch.org/docs/stable/nn.init.html. User provided .zUnknown initializer name: z$ is not a method in `torch.nn.init`!rzUnknown initializer: z1 is not a initializer in `tf.keras.initializers`!) rrrrrendswithr&rinitrkeras initializers)r r r'r(r#r)r r,r,r-get_initializer_fnWs4      r4cCsdddgdgdddgdgdddgdgg}dddgdgdddgdgdddgdgg}dddgdgdddgdgd ddgdgd ddgdgg}dddgdgdddgdgdddgdgg}dd d gdgdd d gdgg}t|}t|d vr|d dddgks|dd ddgkr|St|d vr|d dddgks|dd ddgkr|St|d vr|d dd d gks|dd d d gkr|St|d vr|d dddgks|dd ddgkr|St|d vr|d dddgks|dd ddgkr|St|gdkrd}nd}td||d)aReturns a default Conv2D filter config (list) for a given image shape. Args: shape (Tuple[int]): The input (image) shape, e.g. (84,84,3). Returns: List[list]: The Conv2D filter configuration usable as `conv_filters` inside a model config dict.   @)r9N`T* )r@zThis is the default atari obs shape. You may want to look at one of RLlib's Atari examples for an example of how to wrap an Atari env. z/No default CNN configuration for obs shape {}. aYou can specify `conv_filters` manually through your AlgorithmConfig's model_config. Default configurations are only available for inputs of the following shapes: [42, 42, K], [84, 84, K], [64, 64, K], [10, 10, K]. You may want to use a custom RLModule or a ConnectorV2 for that.)listlenr&r%)shape filters_96x96 filters_84x84 filters_64x64 filters_42x42 filters_10x10 atari_helpr,r,r-get_filter_configsT              44444rQcCst|r|S|dkr/t\}}|dusJdddlm}|dvr&|jS|dkr/|jS|dkrQt\}}|dus@Jd|dvrH|jj S|dkrP|jj Sn+|d vs\Jd |t \}}}|dusjJd |dvrs|j jjS|dkr||j jjStd ||) aReturns a framework specific initializer, given a name string. Args: name: One of "xavier_uniform" (default), "xavier_normal". framework: One of "jax", "tf|tf2" or "torch". Returns: A framework-specific initializer function, e.g. tf.keras.initializers.GlorotUniform or torch.nn.init.xavier_uniform_. Raises: ValueError: If name is an unknown initializer. rNz1`flax` not installed. Try `pip install jax flax`.r)Ndefaultxavier_uniform xavier_normalr z/`torch` not installed. Try `pip install torch`.rrz9`tensorflow` not installed. Try `pip install tensorflow`.r)rr flax.linenlinenr3rSrTrr1xavier_uniform_xavier_normal_r%rr2 GlorotUniform GlorotNormalr&)r r r(flaxr#r*r r+r,r,r-get_initializers@          r\)Nr )r )r )typingrrrray.rllib.utils.annotationsrray.rllib.utils.frameworkrrrrr.r4rQr\r,r,r,r-s"  O"P G