o i @sddlmZmZmZmZmZmZddlZddlZ ddl Z ddl m Z ddl mZmZmZmZmZ d,dedeed ed efd d Zdeeefd efd dZded efddZded efddZd-deded eefddZd.dededed dfddZd.dededed dfddZ  d/dedeededed df d d!Zd-deded eefd"d#Z  d/dedeededed df d$d%Z d&ed efd'd(Z! d-d)eeded eefd*d+Z"dS)0)UnionIterableSequenceAnyOptionalIteratorN)ujson) force_path force_stringFilePath JSONInput JSONOutputFdataindent sort_keysreturncCs>|r|dkrdn|}tj||d|d}|Stj||dd}|S)aSerialize an object to a JSON string. data: The JSON-serializable data. indent (int): Number of spaces used to indent JSON. sort_keys (bool): Sort dictionary keys. Falls back to json module for now. RETURNS (str): The serialized string. rN),:)r separatorsrF)rescape_forward_slashes) _builtin_jsondumpsr )rrrresultrC/home/ubuntu/.local/lib/python3.10/site-packages/srsly/_json_api.py json_dumps s rcCs|dkrtdt|S)zDeserialize unicode or bytes to a Python object. data (str / bytes): The data to deserialize. RETURNS: The deserialized Python object. -zExpected object or value) ValueErrorr loads)rrrr json_loadss r pathcCs`|dkrtj}t|St|}|jddd }t|WdS1s)wYdS)zLoad JSON from file or standard input. path (FilePath): The file path. "-" for reading from stdin. RETURNS (JSONOutput): The loaded JSON content. rrutf8encodingN)sysstdinreadr rr openload)r!r file_pathfrrr read_json*s  $r-cCsBt|}t|d }t|WdS1swYdS)zLoad JSON from a gzipped file. location (FilePath): The file path. RETURNS (JSONOutput): The loaded JSON content. r"N)r gzipr)r r*)r!r+r,rrrread_gzip_json8s$r/skipccsPtt|d}t||dD]}|VqWddS1s!wYdS)aRead a gzipped .jsonl file and yield contents line by line. Blank lines will always be skipped. path (FilePath): The file path. skip (bool): Skip broken lines and don't raise ValueError. YIELDS (JSONOutput): The unpacked, deserialized Python objects. r"r0N)r.r)r _yield_json_lines)r!r0r,linerrrread_gzip_jsonlCs "r4cCsjt||d}|dkrt|dSt|dd}|jddd}||WddS1s.wYdS) aCreate a .json file and dump contents or write to standard output. location (FilePath): The file path. "-" for writing to stdout. data (JSONInput): The JSON-serializable data to output. indent (int): Number of spaces used to indent JSON. rrFrequire_existswr#r$N)rprintr r)writer!rr json_datar+r,rrr write_jsonPs    "r>cCsVt||d}t|}t|d}||dWddS1s$wYdS)zCreate a .json.gz file and dump contents. path (FilePath): The file path. data (JSONInput): The JSON-serializable data to output. indent (int): Number of spaces used to indent JSON. r6r9utf-8N)rr r.r)r;encoder<rrrwrite_gzip_jsonas "rATlinesappendappend_new_linecCsx|rdnd}t|dd}tj||d}|r |r |dd|dd |DWd d S1s5wYd S) aCreate a .jsonl.gz file and dump contents. location (FilePath): The file path. lines (Sequence[JSONInput]): The JSON-serializable contents of each line. append (bool): Whether or not to append to the location. Appending to .gz files is generally not recommended, as it doesn't allow the algorithm to take advantage of all data when compressing - files may hence be poorly compressed. append_new_line (bool): Whether or not to write a new line before appending to the file. ar9Fr7)mode r?cSsg|] }t|ddqS)rGr?)rr@).0r3rrr sz$write_gzip_jsonl..N)r r.r)r;r@ writelines)r!rBrCrDrFr+r,rrrwrite_gzip_jsonlns  "rKccs||dkrttj|dD]}|Vq dSt|}|jddd}t||dD]}|Vq&WddS1s7wYdS)a2Read a .jsonl file or standard input and yield contents line by line. Blank lines will always be skipped. path (FilePath): The file path. "-" for reading from stdin. skip (bool): Skip broken lines and don't raise ValueError. YIELDS (JSONOutput): The loaded JSON contents of each line. rr1r"r#r$N)r2r&r'r r))r!r0r3r+r,rrr read_jsonls"rLcCs|dkr|D]}tt|qd S|rdnd}t|dd}|j|dd }|r.|r.|d|D] }|t|dq0Wd d S1sGwYd S) a|Create a .jsonl file and dump contents or write to standard output. location (FilePath): The file path. "-" for writing to stdout. lines (Sequence[JSONInput]): The JSON-serializable contents of each line. append (bool): Whether or not to append to the location. append_new_line (bool): Whether or not to write a new line before appending to the file. rrEr9Fr7r?r$rGN)r:rr r)r;)r!rBrCrDr3rFr+r,rrr write_jsonls   "rMobjc Cs8t|drdSzt|WdSttfyYdSw)zCheck if a Python object is JSON-serializable. obj: The object to check. RETURNS (bool): Whether the object is JSON-serializable. __call__FT)hasattrr r TypeError OverflowError)rNrrris_json_serializables  rSstreamc csjd}|D]-}|}|dkrqzt|VWnty-|r#Yqtd|d|w|d7}qdS)NrzInvalid JSON on line z: )stripr rr)rTr0line_nor3rrrr2s  r2)rF)F)r5)FT)#typingrrrrrrr&jsonrr.rUr utilr r r r rintboolstrrbytesr r-r/r4r>rArKrLrMrSr2rrrrst