o ^iV @sDdZddlZddlZddlZddlZddlZddlZddlZddl Z ddl Z ddl m Z m Z mZddlmZddlmZddlmZddlmZddlmZmZdd lmZdd lmZmZmZdd l m!Z!dd l"m#Z#ddl$Z$ddl%Z%dd l&m'Z'ddl(m)Z)ddl*m+Z+m,Z,m-Z-m.Z.m/Z/ddl0m1Z1ddl2m3Z3m4Z4m5Z5m6Z6Gddde j7j8Z9e:dZ;e:dpe:dpe;ZiZ?dZ@e<re!e<ZAeAjBCd\ZDZEZFe>e)dkrde$jGehs z+_fetch_package_metadata..) author bugtrack_urldocs_url home_pagelicense package_url project_url project_urlssummary)rF status_codejsonloadstext)r+r<r=r>responser&rIr'_fetch_package_metadataZs  rZc sheZdZdZeddddZeddddZeddd dZ ed dd dZ d1d e e de e de e jdd ffdd ZedefddZdede efddZdedefddZdededefddZedd d!Zd"ed#ed$edee eefe effd%d&Zde eeeffd'd(Z!d2d)ed*e ede"fd+d,Z#dede"fd-d.Z$d)edefd/d0Z%Z&S)3PyPIExtensionManagerrzhttps://pypi.org/pypiTzThe base URL of PyPI index.)rhelpgr@z.PyPI extensions list cache timeout in seconds.iz$The cache size for package metadata.g?zGThrottling time in seconds between PyPI requests using the XML-RPC API.N app_options ext_optionsparentr?cst|||tjd it|_tt|j|_|d|j it j j |j td|_tjtjdt|jdd|_d|_|jd|j dtrV|jdtjdSdS) Nnew) transporttz)\(?secondsz%Extensions list will be fetched from .z=Extensions will be fetched using proxy, proxy host and port: r&)super__init__httpx AsyncClient_httpx_client_args _httpx_clientrrZ$_observe_package_metadata_cache_sizepackage_metadata_cache_sizexmlrpcr+ ServerProxyr>xmlrpc_transport_override _rpc_clientrnowrutcr cache_timeout5_PyPIExtensionManager__last_all_packages_request_time)_PyPIExtensionManager__all_packages_cachelogdebugrEr )r"r]r^r_ __class__r&r'ris"  zPyPIExtensionManager.__init__cCstddtjS)zExtension manager metadata.PyPIT)rsysprefixr"r&r&r'metadataszPyPIExtensionManager.metadatapkgcsz2|jj|jd|dddidIdH}|jdkr&t|jdi}n |jd |WdSWn t y=YdSwt |d d pHdS) zReturn the latest available version for a given extension. Args: pkg: The extension to search for Returns: The latest available version r@rArBrCr)NrDrEz+Failed to get package information on PyPI; version) rmrFr>rUrVrWcontentryrz Exceptionrget_semver_version)r"rrYrJr&r&r'get_latest_versions  z'PyPIExtensionManager.get_latest_version extensioncCs6|jdur|j}|ddkr||dS||jS)aNormalize extension name. Extension have multiple parts, npm package, Python package,... Sub-classes may override this method to ensure the name of an extension from the service provider and the local installed listing is matching. Args: extension: The extension metadata Returns: The normalized name NpackageManagerpython packageName)install_normalize_namer<)r"rinstall_metadatar&r&r'get_normalized_names   z(PyPIExtensionManager.get_normalized_name recursivefnc s.tjj}z|jd|g|RIdH}W|Stjjy}zq|jdkr}|j drd}t d|j }|durBt |dp@d}|jd|d t||jd IdH|ri|jd |g|RIdH}n"|jd|g|RIdH}WYd}~|SWYd}~|SWYd}~|SWYd}~|Sd}~ww) a/Throttle XMLRPC API request Args: recursive: Whether to call the throttling recursively once or not. fn: API method to call *args: API method arguments Returns: Result of the method Raises: xmlrpc.client.Fault Ni zHTTPTooManyRequests:rdz!Limit may reset in (\d+) seconds.1z>HTTPTooManyRequests - Perform next call to PyPI XMLRPC API in zs.g{Gz?F)tornadoioloopIOLoopcurrentrun_in_executorrpr+Fault faultCode faultString startswithresearchintgroupryrEasynciosleeprpc_request_throttling&_PyPIExtensionManager__throttleRequest) r"rrargs current_looprJerrdelaymatchr&r&r'__throttleRequests:  $   z&PyPIExtensionManager.__throttleRequestrocCs t|ddtt|j|_dS)Nr`)maxsize)rrrZrm)r"changer&r&r'rns   z9PyPIExtensionManager._observe_package_metadata_cache_sizequerypageper_pagecs|IdH}i}g}ttfdd|ddD]\}}t|d\} } ||| |jIdH} ||} | dps z4PyPIExtensionManager.list_packages..cSs|dSrr&)er&r&r'rrSz Source CoderOHomepagerN DocumentationrMz Bug TrackerrRrQrTrLrPprebuilt) r< description homepage_urlrLrPr=pkg_typebug_tracker_urldocumentation_urlpackage_manager_urlrepository_urlcSsg|] }|rt|qSr&)strlower)rGurlr&r&r' >s  z6PyPIExtensionManager.list_packages..z-https://github.com/jupyterlab/jupyterlab_apodz0https://github.com/jupyterlab/extension-examplesc3s|]}|vVqdSrr&)rGorg)rr&r' Js  z5PyPIExtensionManager.list_packages..)zgithub.com/jupyter/z jupyter.orgzgithub.com/jupyterlab/rzgithub.com/jupyterlab-contrib/cSs|d|djfS)Nrrr<)xr&r&r'rVs)key))_PyPIExtensionManager__get_all_extensionsrfilterlistrZr>rrFrrranyappendsortedr<mathceillen)r"rrrmatches extensions all_matchesr<r_r=rJnormalized_name package_urls source_urlrrrbest_guess_home_urlrpriority urls_to_checkexcludesorted_matches start_idxend_idx page_matches total_pagesr&)rrr' list_packagess$        z"PyPIExtensionManager.list_packagescsj|jdustjtjd|jt|jdkr2|j d| d|j j dgIdH|_tjtjd|_|jS)Nrbrez?Requesting PyPI.org RPC API for prebuilt JupyterLab extensions.TzwYWd d S1sOwYd S);aInstall the required extension. Note: If the user must be notified with a message (like asking to restart the server), the result should be {"status": "warning", "message": ""} Args: name: The extension name version: The version to install; default None (i.e. the latest possible) Returns: The action result zw+F)modedirdeletez jupyterlab==-mpipr --no-inputz--quietz--progress-baroffz --constraintNz==rz --dry-runz--report-T)capture_outputcheckutf-8cs|didddkS)Nrr<rr)rFreplace)prr&r'rsz.PyPIExtensionManager.install..z!Fail to get installation report: exc_infoz Fail to get installation report.zActions to be executed by pip rg Executing ' 'r return code: stdout: rstderr: download_inforrDz.whlcSt|jdkSNz package.jsonr r<fr&r&r'r jupyterlabztar.gzcSrrrrr&r&r'rrzFailed to get 'z'; zFail to get package.json.frontend discoverykernelserverokstatus needs_restartzFailed to install : code  errorr message)2rrrrtempfileTemporaryDirectoryNamedTemporaryFilewriterflushr~ executabler<rcopyinsertrrr rVrWstdoutdecodenextrrFr ryrzstderrrdumpsjoin returncodermrUendswithrioBytesIOrnamelistreadr getnamesload extractfile getmemberrr)r"r<rrve_dir fconstraintcmdline pkg_actiontmp_cmdresult action_inforrr jlab_metadata download_urlrYwheelfilenamerJsdist follow_upsrr&rr'rrs         $                    i VzPyPIExtensionManager.installc stjj}tjddddd|g}d}zJ|}|d|dt t |ddIdH}t d d t d d |j d }t d d t t|D]}t|} | d}|dur[nqGWntyw} z|jjd| dWYd} ~ nd} ~ ww|jdd|d|dt t |ddIdH}|jd|j|jd|j d |jd } |jdkr|jd| dg} |dur|di} d| vr| dd| vr| dtd| dS|jd|d|jd | td!| d"S)#ajUninstall the required extension. Note: If the user must be notified with a message (like asking to restart the server), the result should be {"status": "warning", "message": ""} Args: extension: The extension name Returns: The action result rr uninstallz--yesrNTrcSs |dSr)r#liner&r&r'r z0PyPIExtensionManager.uninstall..cSs|Sr)stripr:r&r&r'rrrcSs |jdkSrrrr&r&r'rr<rz%Fail to list files to be uninstalled.rrrrrrrrrrr r r r zFailed to installed rrrr)rrrrr~rrremoverrr rmaprr splitlinesr rVrW read_bytesrFrryrzr!r"rrrr)r"rrr.r3r0r1linesfilepathrJrrr8rr&r&r'r9sn              zPyPIExtensionManager.uninstallcCs|ddddddS)zNormalize extension name. Remove `@` from npm scope and replace `/` and `_` by `-`. Args: name: Extension name Returns: Normalized name @rr@rr)r)r"r<r&r&r'r6s z$PyPIExtensionManager._normalize_name)NNNr)'r1r2r3__doc__rr>rrvrrorrdictr Configurableripropertyrrrrrrboolrr rrrnrtuplerrrrrr9r __classcell__r&r&r{r'r[zs\"  f{Ir[)NrEr http.clientr*r$rVrrr~r xmlrpc.clientrprrr functoolsr itertoolsrosrpathlibr subprocessr r tarfiler typingr rr urllib.parserzipfilerrjr async_lrurpackaging.versionr traitletsrrrrrjupyterlab._versionrjupyterlab.extensions.managerrrrrr+ TransportrrF all_proxy_urlhttp_proxy_urlhttps_proxy_url_httpx_versionrlrrr5netloc partition proxy_hostr proxy_portAsyncHTTPTransportr(rkrrFrZr[r&r&r&r's~