o bi@sTzddlZWn eydZYnwdddefddZ d dddedd fd d ZdS) Ncazpyarrow.ChunkedArrayreturncCst|jtjS)zfWhether the provided Arrow Table column is an extension array, using an Arrow extension type. ) isinstancetypepyarrow ExtensionType)rrR/home/ubuntu/.local/lib/python3.10/site-packages/ray/air/util/transform_pyarrow.py_is_column_extension_typesr F ensure_copyz pyarrow.ArraycCsddlm}m}t|std|}|jdkr"tjg|jj d}n&t |j|r/| |j |S|s=t |j dkr=|j dStdd|j D}|j|j|S)aConcatenate chunks of an extension column into a contiguous array. This concatenation is required for creating copies and for .take() to work on extension arrays. See https://issues.apache.org/jira/browse/ARROW-16503. Args: ca: The chunked array representing the extension column to be concatenated. ensure_copy: Skip copying when ensure_copy is False and there is exactly 1 chunk. r)ArrowTensorArray get_arrow_extension_tensor_typesz,Chunked array isn't an extension array: {ca})rcSsg|]}|jqSr)storage).0crrr .sz1_concatenate_extension_column..)$ray.air.util.tensor_extensions.arrowr r r ValueError num_chunksrarrayr storage_typer_concat_same_typechunkslen concat_arrays__arrow_ext_class__ from_storage)rr r r tensor_extension_typesrrrr _concatenate_extension_columns    r)F)r ImportErrorboolr rrrrr s