o i@sdZddlZddlZzddlZddlZddlZWn ey#dZYnwddl Z ddl Z ddl m Z e eZdZ dZ ddiZdd Zd d Zd d ZdeddddfddZ     dddZ    dddZdS)zAImplements file-like objects for reading and writing to/from GCS.NT) constantsgsi  ignore_flushcCs:tj|}|jtks J|j}|jd}tt||dS)N/)scheme bucket_idblob_id) smart_openutils safe_urlsplitrSCHEMEnetlocpathlstripdict) uri_as_stringsrrrrB/home/ubuntu/.local/lib/python3.10/site-packages/smart_open/gcs.py parse_uri$s  rcCs2t|}tjt|}t|d|d|fi|S)Nrr)rr r check_kwargsopen)urimodetransport_params parsed_urikwargsrrropen_uri,srcCsd|d}t|tdS)Nz Parameter z7 is deprecated, this parameter no-longer has any effect)warningswarn UserWarning)parameter_namemessagerrrwarn_deprecated2s r#c Csz|duri}|durtd|tjddfvr!t|||||d} | S|tjddfvr5t||||||d} | Std |d ) aOpen an GCS blob for reading or writing. Parameters ---------- bucket_id: str The name of the bucket this object resides in. blob_id: str The name of the blob within the bucket. mode: str The mode for opening the object. Must be either "rb" or "wb". buffer_size: deprecated min_part_size: int, optional The minimum part size for multipart uploads. For writing only. client: google.cloud.storage.Client, optional The GCS client to use when working with google-cloud-storage. get_blob_kwargs: dict, optional Additional keyword arguments to propagate to the bucket.get_blob method of the google-cloud-storage library. For reading only. blob_properties: dict, optional Set properties on blob before writing. For writing only. blob_open_kwargs: dict, optional Additional keyword arguments to propagate to the blob.open method of the google-cloud-storage library. N buffer_sizerrt)bucketkeyclientget_blob_kwargsblob_open_kwargswwt)r'blob min_part_sizer)blob_propertiesr+zGCS support for mode z not implemented)r#r READ_BINARYReader WRITE_BINARYWriterNotImplementedError) rrrr$r/r)r*r0r+_blobrrrr7s,% rc Cs|duri}|dur i}|durtjj}|durtd|dur&td||}|j|fi|}|durEtjjd|d||j di|S)Nr$line_terminatorzblob z not found in rb)r8) googlecloudstorageClientr#r'get_blob exceptionsNotFoundr) r'r(r$r7r)r*r+bktr.rrrr2ws  r2c Cs|duri}|dur i}|durtjj}it|}||j||d}|D] \}}t|||q*|j di|} dd| _ | S)N) chunk_sizewbcSsdS)NrrrrrszWriter..)rB) r9r:r;r<_DEFAULT_WRITE_OPEN_KWARGSr'r.itemssetattrr terminate) r'r.r/r)r0r+g_blobkvr6rrrr4s     r4)NNNNN)NNNN)__doc__loggingrgoogle.cloud.exceptionsr9google.cloud.storagegoogle.auth.transport.requests ImportError MISSING_DEPSsmart_open.bytebufferr smart_open.utilsr getLogger__name__loggerr _DEFAULT_MIN_PART_SIZErDrrr#rr2r4rrrrsP      B