o ,wi(@sXdZddlZddlZddlZddlZddlmZmZmZm Z m Z m Z ddl m Zddl mZddl mZddl mZddl mZe ed efe efZGd d d ejd Zd"d dZejddGdddeZejddGdddeZeZdedefddZ d"ddejdddejde ede ejdede ejde edefd d!Z dS)#zLibrary for manipulating selections of a Buildable DAG. A common need for configuration libraries is to override settings in some kind of base configuration, and these APIs allow such overrides to take place imperatively. N)AnyCallableIteratorOptionalTypeUnion)config)daglish)mutate_buildable)tag_type)tagging.c@sheZdZdZdeefddZejdde ddfdd Z ejdd d Z ejd e deefd dZ dS) SelectionzBBase class for selections of nodes/objects/values in a config DAG.returncCstdt|)z"Iterates over the selected values.zIteration is not supported for )NotImplementedErrortypeselfrR/home/ubuntu/sommelier/.venv/lib/python3.10/site-packages/fiddle/_src/selectors.py__iter__+zSelection.__iter__TdeepcopyNcCt)zReplaces all selected nodes/objects/values with a new value. Args: value: Value to replace selected nodes/objects/values with. deepcopy: Whether to deepcopy `value` every time it is set. r)rvaluerrrrreplace/szSelection.replacecKr)zvSets attributes on nodes matching this selection. Args: **kwargs: Attributes to set on matching nodes. rrkwargsrrrset9sz Selection.setnamecCr)Gets all values for a particular attribute. Args: name: Name of the attribute on matching nodes. Yields: Values configured for the attribute with name `name` on matching nodes. rrrrrrgetBs z Selection.getTrN)__name__ __module__ __qualname____doc__rrrabcabstractmethodboolrrstrr"rrrrr (s r ) metaclassccsB|p tjt|}||r||D]}|EdHq|VdS)z6Yields all values (memoized) from a configuration DAG.N)r MemoizedTraversalbegin_memoized_walk_leaves_firstis_traversableyield_map_child_values)rstate sub_resultrrrr0Os    r0T)frozenc@seZdZUdZejed<eeed<e ed<e ejed<dejde fdd Z de ejfd d Z defd d ZeZddede ddfddZdddZdede efddZdS) NodeSelectionaRepresents a selection of nodes. This selection is declarative, so if subtrees / subgraphs of `cfg` change and later match or don't match, a different set of nodes will be returned. Generally this class is intended for modifying attributes of a buildable DAG in a way that doesn't alter its structure. We do not pay particular attention to structure-altering modifications right now; please do not depend on such behavior. cfg fn_or_clsmatch_subclassesbuildable_typenodercCsjt||jsdS|jdur3|jt|kr3|jo.t|jto.tt|to.tt||j}|s3dSdS)z.traverserD) rAr7 ValueErrorr Stater.r/r rJ)rrrrM new_configrrLrrs   zNodeSelection.replacecKs,|D]}|D] \}}t|||qqdS)zSets multiple attributes on nodes matching this selection. Args: **kwargs: Properties to set on matching nodes. N)itemssetattr)rrmatchingrrrrrrs zNodeSelection.setrccs|D]}t||VqdS)r N)getattr)rrrSrrrr"s zNodeSelection.getr#r$)r%r&r'r(r=rI__annotations__r FnOrClassr+rrArrr,rC__repr__rrrr"rrrrr6Ys     r6c@speZdZUdZejed<ejed<de e fddZ dde d e dd fd d Z d ede e fddZdddZd S) TagSelectionz7Represents a selection of fields tagged by a given tag.r7tagrc#s\tjD]%}t|tjr+|jD]\}}tfdd|Dr*t||t j VqqdS)z'Yields all values for the selected tag.c3|] }t|jVqdSNr?rY.0rYrrr z(TagSelection.__iter__..N) r0r7r<r=rI__argument_tags__rQanyrTr NO_VALUE)rrrtagsrrrrs zTagSelection.__iter__TrrNcshtjD],}t|tjr1|jD]\}}tfdd|Dr0|s%|nt |}t |||qqdS)Nc3rZr[r\r]rrrr_r`z'TagSelection.replace..) r0r7r<r=rIrarQrbrGrrR)rrr node_valuerrdto_setrrrrs  zTagSelection.replacercCtd)NzKTo iterate through values of a TagSelection, use __iter__ instead of get().rr!rrrr"zTagSelection.getcKrg)NzsYou can't set named attributes on tagged values, you can only replace them. Please call replace() instead of set().rrrrrrrhzTagSelection.setr#r$)r%r&r'r(r=rIrUr TagTyperrrr+rr,r"rrrrrrXs     rX selectionrcCstt|ttuS)z%Returns whether a selection is empty.)nextiter_missing)rjrrr _is_emptyrrn)rYr9r:check_nonemptyr7r8rYr9r:rocCs|dur|dur td|stdt||}n|dur tdt||||d}|r6t|r6td|d|durCt|rCtd|S) aSelects sub-buildables or fields within a configuration DAG. Example configuring attention classes:: select(my_config, MyDenseAttention).set(num_heads=12, head_dim=512) Example configuring all activation dtypes:: select(my_config, tag=DType).set(value=jnp.float32) Args: cfg: Configuraiton to traverse. fn_or_cls: Select by a given function or class that is being configured. tag: If set, selects all attributes tagged by `tag`. This will return a TagSelection instead of a Selection, which has a slightly different API. match_subclasses: If fn_or_cls is provided and a class, then also match subclasses of `fn_or_cls`. buildable_type: Restrict the selection to a particular buildable type. Not valid for tag selections. check_nonempty: Whether to raise an error on empty selections. This will be true in the future. Returns: A Selection, which is a TagSelection if `tag` is set, and a NodeSelection otherwise. Nz4Selecting by tag and fn_or_cls is not supported yet.z2match_subclasses is ignored when selecting by tag.z)Either tag or fn_or_cls must be provided.)r9r:z Selection zG is empty! If this is OK, please call select(..., check_nonempty=False)ztYour selection was empty. In the future, this will be an error. Please set check_nonempty=False if this is intended.)rrXrNr6rnloggingwarning)r7r8rYr9r:rorjrrrselects6#   rrr[)!r(r)rG dataclassesrptypingrrrrrr fiddle._srcrr=r r r r rVABCMetar r0 dataclassr6rXobjectrmr+rnrIrirrrrrrsR       '  k"