o X۷i7@sddlmZddlZddlmZddlZddlmZddlmZddl m Z ddl m Z dd Z dd d Z d d ZdddZddZddZdddZdddZdS)) annotationsN)linalg)internal)device)_decomposition)_utilc Csddlm}ddlm}m}t||t|t||j dkr't d|j dkrD|j d|j kr8t dt ||j dd}n|j dd|j ddkrVt d |j d krh|j d|krh|||St||\}}|j dkr|t |j |S|j d kr|j|d d d }|j|d d d }||||j|ddS|j|d dd }t j||d}|j dd}tt|D]} t| |} || j|d d d } ||| | | || <q|S)a"Solves a linear matrix equation. It computes the exact solution of ``x`` in ``ax = b``, where ``a`` is a square and full rank matrix. Args: a (cupy.ndarray): The matrix with dimension ``(..., M, M)``. b (cupy.ndarray): The matrix with dimension ``(M,)`` or ``(..., M, K)``. Returns: cupy.ndarray: The matrix with dimension ``(..., M)`` or ``(..., M, K)``. .. warning:: This function calls one or more cuSOLVER routine(s) which may yield invalid results if input conditions are not met. To detect these invalid results, you can set the `linalg` configuration to a value that is not `ignore` in :func:`cupyx.errstate` or :func:`cupyx.seterr`. .. seealso:: :func:`numpy.linalg.solve` rlapack) batched_gesvget_batched_gesv_limitz"b must have at least one dimensionzHa must have (..., M, M) shape and b must have (M,) for one-dimensional bNzPa must have (..., M, M) shape and b must have (..., M, K) for multidimensional bTFcopyorderFrCdtype)cupyxr cupy.cublasr r r_assert_cupy_array_assert_stacked_2d_assert_stacked_squarendim ValueErrorshapesizecupy broadcast_tolinalg_common_typeemptyastypegesv empty_likerangenumpyprod unravel_index) abr r r r out_dtypexriindexbir3H/home/ubuntu/vllm_env/lib/python3.10/site-packages/cupy/linalg/_solve.pysolve sH            r5cCs|dur!tt|j}|D]}||||j|q ||}|j|j|j d}t|}| d|}| }t ||}| |S)aSolves tensor equations denoted by ``ax = b``. Suppose that ``b`` is equivalent to ``cupy.tensordot(a, x)``. This function computes tensor ``x`` from ``a`` and ``b``. Args: a (cupy.ndarray): The tensor with ``len(shape) >= 1`` b (cupy.ndarray): The tensor with ``len(shape) >= 1`` axes (tuple of ints): Axes in ``a`` to reorder to the right before inversion. Returns: cupy.ndarray: The tensor with shape ``Q`` such that ``b.shape + Q == a.shape``. .. warning:: This function calls one or more cuSOLVER routine(s) which may yield invalid results if input conditions are not met. To detect these invalid results, you can set the `linalg` configuration to a value that is not `ignore` in :func:`cupyx.errstate` or :func:`cupyx.seterr`. .. seealso:: :func:`numpy.linalg.tensorsolve` Nr ) listr(rremoveinsert transposerrr*reshaperavelr5)r,r-axesallaxeskoldshaper*resultr3r3r4 tensorsolveWs      rAcCs0|jj}t|}tjt||ddS)Nr axis)rcharlowerr!ascontiguousarraysumsquareview)r/ real_dtyper3r3r4_nrm2_last_axiss  rKcCs|t||t||jdkrtd|j|jdd\}}|jd}||kr0tdtjj |dd\}}}|durLt |j j t||}n|dksT|d kr[t |j j }d |} t|jt j} |jdkr||} || k} d| | <| | jt jd 8} t|j|| j} t|j| }||ks| |krtjd |j d }n|||}tt|j}||| |fS) a}Return the least-squares solution to a linear matrix equation. Solves the equation `a x = b` by computing a vector `x` that minimizes the Euclidean 2-norm `|| b - a x ||^2`. The equation may be under-, well-, or over- determined (i.e., the number of linearly independent rows of `a` can be less than, equal to, or greater than its number of linearly independent columns). If `a` is square and of full rank, then `x` (but for round-off error) is the "exact" solution of the equation. Args: a (cupy.ndarray): "Coefficient" matrix with dimension ``(M, N)`` b (cupy.ndarray): "Dependent variable" values with dimension ``(M,)`` or ``(M, K)`` rcond (float, optional): Cutoff parameter for small singular values. For stability it computes the largest singular value denoted by ``s``, and sets all singular values smaller than ``s`` to zero. Returns: tuple: A tuple of ``(x, residuals, rank, s)``. Note ``x`` is the least-squares solution with shape ``(N,)`` or ``(N, K)`` depending if ``b`` was two-dimensional. The sums of ``residuals`` is the squared Euclidean 2-norm for each column in b - a*x. The ``residuals`` is an empty array if the rank of a is < N or M <= N, but iff b is 1-dimensional, this is a (1,) shape array, Otherwise the shape is (K,). The ``rank`` of matrix ``a`` is an integer. The singular values of ``a`` are ``s``. .. warning:: This function calls one or more cuSOLVER routine(s) which may yield invalid results if input conditions are not met. To detect these invalid results, you can set the `linalg` configuration to a value that is not `ignore` in :func:`cupyx.errstate` or :func:`cupyx.seterr`. .. seealso:: :func:`numpy.linalg.lstsq` rzA{}-dimensional array given. Array must be at most two-dimensionalrNrzIncompatible dimensionsF full_matricesr r)r)rr _assert_2drr LinAlgErrorformatrr!svdr)finforepsmaxarrayr int32rGdotTconjr$ atleast_1drK)r,r-rcondmnm2usvhs1rankcutoff sing_valszr/residser3r3r4lstsqs: '       ricCsddlm}t|t|t||jdkrt|St|\}}|j dkr1t |j |S|j r6dnd}|j|d|d}t j|j d||d}|dkrV|||n||j|j|j|d d S) aComputes the inverse of a matrix. This function computes matrix ``a_inv`` from n-dimensional regular matrix ``a`` such that ``dot(a, a_inv) == eye(n)``. Args: a (cupy.ndarray): The regular matrix Returns: cupy.ndarray: The inverse of a matrix. .. warning:: This function calls one or more cuSOLVER routine(s) which may yield invalid results if input conditions are not met. To detect these invalid results, you can set the `linalg` configuration to a value that is not `ignore` in :func:`cupyx.errstate` or :func:`cupyx.seterr`. .. seealso:: :func:`numpy.linalg.inv` rrrrTr)rrFr)rr rrrrr _batched_invr#r r!r$r _f_contiguousr%eyer&rX)r,r rr.rr-r3r3r4invs      rnc Cs4t|\}}|jdkrt|j|S|tjkr#tjjj }tjjj }n:|tj kr3tjjj }tjjj }n*|tjkrCtjjj}tjjj}n|tjkrStjjj}tjjj}n d|j}t|d|jvritj||dS|j}|j|ddd|d|d}t}|jd}|jd} | } | | |j} |jj} | | |} tj| | | tj d}tj|| ftj!d}tj|ftj!d}||| |jj| |jj|jj|tj"j#||t|}| }| ||j} |jj} | | |} tj| | | tj d}||| |jj| |jj|jj||jj| tj"j#||||j|d d S) NrzDdtype must be float32, float64, complex64 or complex128 (actual: {})rr)rr rr Fr)$rr#r r!r$rfloat32cudacublas sgetrfBatched sgetriBatchedfloat64 dgetrfBatched dgetriBatched complex64 cgetrfBatched cgetriBatched complex128 zgetrfBatched zgetriBatchedrPrrr'r%r:rget_cublas_handleitemsizedataptrarangeuintprVr3_check_cublas_info_array_if_synchronization_allowed)r,rr.getrfgetrimsga_shapehandle batch_sizer]ldastepstartstopa_array pivot_array info_arraycldcc_arrayr3r3r4rksh                    rkV瞯s       J) P, >.