o fi{ @sddlZddlZddlZddlZddlZdededefddZdeededeefd d Zd ed ed ee eefddfddZ    dd ededededdf ddZ dS)Nfile_urlfolderreturncCstj|}tj||}tj|rtd|d|tj|dd}t |d}| |j Wd|S1s?sz._replace_remote_with_local..rrNz..w) rr dirnamereplacelensplitseprr r r) rr(r) relt_pathdepthfopenr%urlfpathpath_upfwrrr_replace_remote_with_local3s     "r; docs/sourcefetched-s3-assets*.rst5https?://[-a-zA-Z0-9_]+\.s3\.[-a-zA-Z0-9()_\\+.\\/=]+ assets_folder file_patternretrieve_patternc Cstjtj|d|dd}|std|d|ddSt||d}|s2td |d |dStj||}tj|dd g}t t |D]%\}} td |d t |d| t | |} | | tj|| fqH|D]} t| ||qpdS)aFind S3 (or HTTP) asset URLs in docs, download them locally, and rewrite references to local paths. Args: docs_folder: The documentation root relative to the project. assets_folder: Subfolder inside ``docs_folder`` used to store downloaded assets (created if missing). file_pattern: Glob pattern of files to scan. retrieve_pattern: Regular-expression pattern used to find remote asset URLs. z**T) recursivez no files were listed in folder "z" and pattern ""N)rz"no resources/assets were match in z for )exist_okz >> downloading (/z): )globrr r r rr'infomakedirs enumeratesetr1rappendr;) r(r@rArBrurls target_folderpairs_url_fileir7rr8rrrfetch_external_assetsKs$   rQ)r<r=r>r?) rGr rr!rstrrlistr'tupler;rQrrrrs.&