o wi*@sUdZddlmZddlZddlZddlZddlmZddlm Z m Z ddl m Z m Z ddlmZddlmZdd lmZdd lmZdd lmZe rWd d lmZd dlmZeee fZde d< GdddeeZ!GdddeeZ"GdddeeZ#dS)a\W&B Public API for Run History. This module provides classes for efficiently scanning and sampling run history data. Note: This module is part of the W&B Public API and provides methods to access run history data. It handles pagination automatically and offers both complete and sampled access to metrics logged during training runs. ) annotationsN)Iterator) TYPE_CHECKINGAny)Self TypeAlias)gql)normalize_exceptions) ServiceApi wandb_api_pb2)MailboxClosedError)runs)RetryingClientr_RowDictc@s\eZdZdZ   d$d%ddZd&ddZd'ddZd(ddZed)dd Z ed*d"d#Z dS)+BetaHistoryScan]Iterator for scanning complete run history. NT service_apir runruns.Runmin_stepintmax_stepkeyslist[str] | None page_size use_cacheboolc Cs||_||_||_||_||_||_tj|jj|jj |jj |j|d}tj |d} tj | d} |j | } | jjj|_d|_g|_||_t||j|j|jdS)N)entityprojectrun_idrr)scan_run_history_initread_run_history_requestr)rrrrr _service_apipbScanRunHistoryInitr r!idReadRunHistoryRequest ApiRequestsend_api_requestread_run_history_responser# request_id_scan_request_id scan_offsetrowsweakreffinalizecleanup) selfrrrrrrrr#scan_run_history_init_request api_requestresponser9M/home/ubuntu/.local/lib/python3.10/site-packages/wandb/apis/public/history.py__init__*s>  zBetaHistoryScan.__init__returnrcCsd|_|j|_g|_|SNr)r0r page_offsetr1r5r9r9r:__iter__`szBetaHistoryScan.__iter__rcCL |jt|jkr|j|j}|jd7_|S|j|jkr!t|q)NTrr0lenr1r>r StopIteration _load_nextr5rowr9r9r:__next__fs  zBetaHistoryScan.__next__Nonecsddlm}tjjj}|j|jj|jdd}|j |d}j |}|j j }fdd|jD_jj7_d_dS)Nrr )rrr.)scan_run_historyr$csg|]}|qSr9)_convert_history_row_to_dict.0rGr?r9r: s z.BetaHistoryScan._load_next..) wandb.protor minr>rrr*ScanRunHistoryr/r+r&r,r- run_history history_rowsr1r0)r5r'rr%r7r8rRr9r?r:rEps$     zBetaHistoryScan._load_next history_row pb.HistoryRowcCsdd|jDS)NcSsi|] }|jt|jqSr9)keyjsonloads value_json)rMitemr9r9r: sz@BetaHistoryScan._convert_history_row_to_dict..) history_items)rTr9r9r:rKsz,BetaHistoryScan._convert_history_row_to_dictr.cCs\tj|d}tj|d}ttt|tj|dWddS1s'wYdS)N)r.)scan_run_history_cleanupr$) r'ScanRunHistoryCleanupr* contextlibsuppressConnectionResetErrorr r,r+)rr.r] scan_run_history_cleanup_requestr9r9r:r4s "zBetaHistoryScan.cleanup)NrT)rr rrrrrrrrrrrrr<rr<rr<rI)rTrUr<r)rr r.rr<rI) __name__ __module__ __qualname____doc__r;r@rHrE staticmethodrKr4r9r9r9r:r$s  6   rc@sLeZdZdZedZ ddd d ZdddZdddZeZ e dddZ dS) HistoryScanrak query HistoryPage($entity: String!, $project: String!, $run: String!, $minStep: Int64!, $maxStep: Int64!, $pageSize: Int!) { project(name: $project, entityName: $entity) { run(name: $run) { history(minStep: $minStep, maxStep: $maxStep, samples: $pageSize) } } } rclientrrrrrrrcCs4||_||_||_||_||_||_d|_g|_dS)aInitialize a HistoryScan instance. Args: client: The client instance to use for making API calls to the W&B backend. run: The run object whose history is to be scanned. min_step: The minimum step to start scanning from. max_step: The maximum step to scan up to. page_size: Number of history rows to fetch per page. Default page_size is 1000. rN)rlrrrrr>r0r1)r5rlrrrrr9r9r:r;s zHistoryScan.__init__r<rcC|j|_d|_g|_|Sr=rr>r0r1r?r9r9r:r@zHistoryScan.__iter__rcCrA)zrReturn the next row of history data with automatic pagination. TrrBrFr9r9r:rH  zHistoryScan.__next__rIcCs|j|j}||jkr|j}|jj|jj|jjt|jt|t|jd}|jj |j |d}|ddd}dd|D|_ |j|j7_d|_ dS) N)r r!rminStepmaxSteppageSizevariable_valuesr!rhistorycSsg|]}t|qSr9)rWrXrLr9r9r:rNsz*HistoryScan._load_next..r) r>rrrr r!r)rrlexecuteQUERYr1r0r5r variablesresr9r9r:rEs    zHistoryScan._load_nextNr) rlrrrrrrrrrrcrdre rfrgrhrirrxr;r@rHnextr rEr9r9r9r:rks  rkc@sLeZdZdZedZ ddddZdddZdddZeZ e dddZ dS) SampledHistoryScanzYIterator for sampling run history data. a. query SampledHistoryPage($entity: String!, $project: String!, $run: String!, $spec: JSONString!) { project(name: $project, entityName: $entity) { run(name: $run) { sampledHistory(specs: [$spec]) } } } rrlrrrr list[str]rrrrcCs:||_||_||_||_||_||_||_d|_g|_dS)aInitialize a SampledHistoryScan instance. Args: client: The client instance to use for making API calls to the W&B backend. run: The run object whose history is to be sampled. keys: List of keys to sample from the history. min_step: The minimum step to start sampling from. max_step: The maximum step to sample up to. page_size: Number of sampled history rows to fetch per page. Default page_size is 1000. rN) rlrrrrrr>r0r1)r5rlrrrrrr9r9r:r;s zSampledHistoryScan.__init__r<rcCrmr=rnr?r9r9r:r@%rozSampledHistoryScan.__iter__rcCrA)zzReturn the next row of sampled history data with automatic pagination. TrrBrFr9r9r:rH+rpzSampledHistoryScan.__next__rIc Cs|j|j}||jkr|j}|jj|jj|jjt|j t |jt |t |jdd}|j j |j |d}|ddd}|d|_|j|j7_d|_dS)N)rrqrrsamples)r r!rspecrtr!rsampledHistoryr)r>rrrr r!r)rWdumpsrrrlrwrxr1r0ryr9r9r:rE;s&    zSampledHistoryScan._load_nextNr|) rlrrrrrrrrrrrrcrdrer}r9r9r9r:rs  r)$ri __future__rr_rWr2collections.abcrtypingrrtyping_extensionsrr wandb_gqlrwandb.apis.normalizer wandb.apis.public.service_apir rOr r'wandb.sdk.mailbox.mailboxr rapirdictstrr__annotations__rrkrr9r9r9r:s*         yX