o $i@s`ddlmZzddlZWn eydZYnwdddefddZ dd d d edd fd dZdS))concat_tensor_arraysNpa_typezpyarrow.lib.DataTypereturncCs t|tjS)zfWhether the provided Arrow Table column is an extension array, using an Arrow extension type. ) isinstancepyarrow ExtensionType)rr[/home/ubuntu/veenaModal/venv/lib/python3.10/site-packages/ray/air/util/transform_pyarrow.py_is_pa_extension_type s r Fcazpyarrow.ChunkedArray ensure_copyz pyarrow.ArraycCsddlm}t|jstd|}|jdkr!tjg|jjd}n%|s/t |j dkr/|j dSt |j|r;t |j |St dd|j D}|j|S)aConcatenate chunks of an extension column into a contiguous array. This concatenation is required for creating copies and for .take() to work on extension arrays. See https://issues.apache.org/jira/browse/ARROW-16503. Args: ca: The chunked array representing the extension column to be concatenated. ensure_copy: Skip copying when ensure_copy is False and there is exactly 1 chunk. r) get_arrow_extension_tensor_typesz,Chunked array isn't an extension array: {ca})typecSsg|]}|jqSr)storage).0crrr /sz1_concatenate_extension_column..)$ray.air.util.tensor_extensions.arrowr r r ValueError num_chunksrarray storage_typelenchunksrr concat_arrays wrap_array)r r r tensor_extension_typesrrrr _concatenate_extension_columns      r)F)rrr ImportErrorboolr rrrrr s