o bim @sUddlZddlmZmZddlmZmZmZmZm Z ddl m Z m Z daeeed<daee ed<dee fdd Zd ed eeefdefd d ZdedefddZdS)N)DictOptional) parse_qslunquote urlencodeurlparse urlunparse)Versionparse_PYARROW_INSTALLED_PYARROW_VERSIONreturncCs^tdurdStdur-zddl}dat|drt|jaWtSWtSty,daYtSwtS)z@Get the version of the pyarrow package or None if not installed.FNrT __version__)r pyarrowhasattr parse_versionrr ModuleNotFoundError)rrL/home/ubuntu/.local/lib/python3.10/site-packages/ray/_private/arrow_utils.pyget_pyarrow_version s    rurlparamscCsdt|}t|}|}tt|j}|||dd|Dt|dd}|j|d}t |S)aAdd params to the provided url as query parameters. If url already contains query parameters, they will be merged with params, with the existing query parameters overriding any in params with the same parameter name. Args: url: The URL to add query parameters to. params: The query parameters to add. Returns: URL with params added as query parameters. cSs*i|]\}}t|ttfr|t|qSr) isinstancebooldictjsondumps).0kvrrr 5s   z)_add_url_query_params..T)doseq)query) rrrrr"updateitemsr_replacer)rr parsed_url base_paramsencoded_paramsrrr_add_url_query_paramss  r)uricCsBt}|dur|tdkr|St|}|jdkrt|ddi}|S)aDIf the provided URI is an S3 URL, add allow_bucket_creation=true as a query parameter. For pyarrow >= 9.0.0, this is required in order to allow ``S3FileSystem.create_dir()`` to create S3 buckets. If the provided URI is not an S3 URL or if pyarrow < 9.0.0 is installed, we return the URI unchanged. Args: uri: The URI that we'll add the query parameter to, if it's an S3 URL. Returns: A URI with the added allow_bucket_creation=true query parameter, if the provided URI is an S3 URL; uri will be returned unchanged otherwise. Nz9.0.0s3allow_bucket_creationT)rrrschemer))r*pyarrow_version parsed_urirrr%add_creatable_buckets_param_if_s3_uriDs r0)rtypingrr urllib.parserrrrrpackaging.versionr r rr r__annotations__r rstrr)r0rrrrs &