o iS @sUddlZddlZddlZddlZddlZddlZddlZddlZddlm Z ddl m Z ddl m Z mZmZmZmZmZmZmZmZmZmZddlZddlmZddlmZmZmZddlm Z dd l!m"Z"m#Z#m$Z$m%Z%m&Z&m'Z'm(Z(m)Z)m*Z*m+Z+dd l!m,Z-dd l!m.Z/dd l!m0Z0e d ddZ1e e2e3d <ddl m4Z4ddl5m6Z6ddl6m7Z7m8Z8m9Z9m:Z:m;Z;mZ>dddZ?ddZ@ddZAddeBddfddZCde de2fd d!ZDde de2fd"d#ZEde de2fd$d%ZFde de2fd&d'ZGde de2fd(d)ZHde de2fd*d+ZIde de2fd,d-ZJde de2fd.d/ZKde de2fd0d1ZLde de2fd2d3ZMde de2fd4d5ZNd6d7ZOd8eBdd9fd:d;ZPde2fdd?ZRdd8eBde2fd@dAZSdBe8dCe8ddfdDdEZT ddFdGdHe:dIeeBdJeUde9fdKdLZVdMdNdOee8e>/home/ubuntu/.local/lib/python3.10/site-packages/thinc/util.pyget_torch_default_device9s        r@cCs,t|rtSt|r tStdt|d)Nz4Only numpy and cupy arrays are supported, but found z` instead. If get_array_module module wasn't called directly, this might indicate a bug in Thinc.)is_numpy_arraynumpy is_cupy_arrayrr4type)arrr>r>r?get_array_moduleKsrFcCstSN)rr>r>r>r?gpu_is_availableYsrHseedcCslt|tj|trt|tr0tj|tr2tr4tj |dtj j _ dtj j _dSdSdSdS)z@Set the random seed across random, numpy.random and cupy.random.TFN)randomrIrBrr! manual_seedrrrr9manual_seed_allr5cudnn deterministic benchmark)rIr>r>r?fix_random_seed]s      rPobjcCt|pt|S)z1Check whether an object is a numpy or cupy array.)rArCrQr>r>r? is_xp_arraykrTcCtsdSt|tjr dSdS)z(Check whether an object is a cupy array.FT)rr8rndarrayrSr>r>r?rCps  rCcCst|tjrdSdS)z)Check whether an object is a numpy array.TF)r8rBrWrSr>r>r?rAzs rAcCs tdurdSt|tjrdSdSNFT)r!r8TensorrSr>r>r?is_torch_arrays  rZcCst|o|jSrG)rZis_cudarSr>r>r?is_torch_cuda_arraysr\cCrRrG)r\is_torch_mps_arrayrSr>r>r?is_torch_gpu_arraysr^cCst|o t|do |jS)Nis_mps)rZhasattrr_rSr>r>r?r]sr]cCrVrX)rr8tfrYrSr>r>r?is_tensorflow_arrays  rbcCst|od|jvS)NzGPU:)rbr;rSr>r>r?is_tensorflow_gpu_arraysrccCstsdSt|tjjr dSdSrX)rr8mxndNDArrayrSr>r>r?is_mxnet_arrays rgcCst|o |jjdkS)Nr3)rgcontext device_typerSr>r>r?is_mxnet_gpu_arraysrjcCs2t|tjr|Strt|tjr|St|SrG)r8rBrWrrgetarray)datar>r>r?to_numpys  rngpu_idzcupy.cuda.DevicecCs6tstdtjj|}|trtj ||S)z=Set the current GPU device for cupy and torch (if available).zNo CUDA GPU devices detected) rr4rr9r;Deviceuserr! set_device)ror;r>r>r?set_active_gpus rscCs$ddlm}m}|d}||dS)z'Use CPU through best available backend.r)get_opsset_current_opsr3T)r5rtru)rtrur<r>r>r? require_cpusrvcCstrt|dtS)z?Use GPU if it's available. Returns True if so, False otherwise.ro)r require_gpurwr>r>r? prefer_gpus rycCsddlm}m}m}tdkrtstrtdtdtdkr(t s(tdt s.tdt r;||t |dS||dS) Nr)r0r1ruDarwinz6Cannot use GPU, installed PyTorch does not support MPSz(Cannot use GPU, PyTorch is not installedz%Cannot use GPU, CuPy is not installedzNo GPU devices detectedT) r5r0r1ruplatformsystemrrr4rrrrs)ror0r1rur>r>r?rxs  rxdstsrccCs^t|tjrt|tjr||dd<dSt|r'tj|dd}t||dSt||dS)NF)copy)r8rBrWrCrrlcopyto)r}r~r>r>r? copy_arrays r)label_smoothingY n_classesrcCs|dur tt|d}|dkrtd|dkr$|dkr!tdd}n|dks0td|d||d}|d|}|dkrR||krRtd|d |d |d t|}|j||f|d d }||d|||S)Nrrz>Label-smoothing parameter has to be greater than or equal to 0rzn_classes should be at least 1zGn_classes should be greater than 1 when label smoothing is enabled,but z was provided.zFor z7 classes label_smoothing parameter has to be less than z , but found .float32)dtype)intrBmaxr4rFfull fill_diagonal)rrr nongold_prob max_smoothxp label_distrr>r>r?to_categoricals<  rdimXrcCst|tr t|j|dSt|trt|j|dSt|drDt|drDtt|}t|j dkr0dSt|j dkr?t | dS|j |St|t t fr[t|dkrSdSt|d|dSd}t|)zrInfer the 'width' of a batch of data, which could be any of: Array, Ragged, Padded or Sequence of Arrays. rshapendimrrz=Cannot get width of object: has neither shape nor __getitem__)r8r+ get_widthrmr*r`rr'lenrrrlisttupler4)rrerrr>r>r?r s"     rcCsd}ts t|jdddS)z4Raise an ImportError if TensorFlow is not installed.z~TensorFlow support requires {pkg}: pip install thinc[tensorflow] Enable TensorFlow support with thinc.api.enable_tensorflow()ztensorflow>=2.0.0,<2.6.0)pkgN)r ImportErrorformat)templater>r>r?assert_tensorflow_installed<srcCtstddS)z/Raise an ImportError if MXNet is not installed.zjMXNet support requires mxnet: pip install thinc[mxnet] Enable MXNet support with thinc.api.enable_mxnet()N)rrr>r>r>r?assert_mxnet_installedCs rcCr)z1Raise an ImportError if PyTorch is not installed.z8PyTorch support requires torch: pip install thinc[torch]N)rrr>r>r>r?assert_pytorch_installedKsris_match convert_itemcs|r|St|trtt|}t|St|tr>i}|D]\}}t|}t|}|||<q'|St|trMfdd|DSt|tr^tfdd|DS|S)zEither convert a single value if it matches a given function, or recursively walk over potentially nested lists, tuples and dicts applying the conversion, and returns the same type. Also supports the ArgsKwargs dataclass. csg|]}t|qSr>convert_recursive.0itemrrr>r? fsz%convert_recursive..c3s|] }t|VqdSrGrrrr>r? hsz$convert_recursive..)r8r&rritems from_itemsdictr)rrrQ convertedkeyvaluer>rr?rQs"        rccs||r |VdSt|trt|t|EdHdSt|tr=|D]\}}t||EdHt||EdHq&dSt|tsGt|trT|D] }t||EdHqIdSdS)zEither yield a single value if it matches a given function, or recursively walk over potentially nested lists, tuples and dicts yielding matching values. Also supports the ArgsKwargs dataclass. N)r8r&iterate_recursiverrrr)rrQrrrr>r>r?rms   r xp_tensor requires_gradr;z torch.TensorcCstt|dur t}t|dr|}tjj|}nt|dr(tjj|}nt|}| |}|r8| |S)z3Convert a numpy or cupy tensor to a PyTorch tensor.NtoDlpack __dlpack__) rr@r`rr!utilsdlpack from_dlpack from_numpytorequires_grad_)rrr; dlpack_tensor torch_tensorr>r>r?xp2torchs    r)r<rr<r,cCsrddlm}tt|r#t||r|Stt j j |St||s,|dur4|St |S)zConvert a torch tensor to a numpy or cupy tensor depending on the `ops` parameter. If `ops` is `None`, the type of the resultant tensor will be determined by the source tensor's device. rNumpyOpsN)apirrr\r8detachr3rBrr!rr to_dlpackrasarray)rr<rr>r>r?torch2xps   r as_variablez tf.TensorcCstt|dr|}tjj|}nt|dr%|}tjj|}nt|}|rIt |j tj ||d}Wdn1sDwY|durm|durmt |j t |}Wd|S1shwY|S)zAConvert a numpy or cupy tensor to a TensorFlow Tensor or Variablerr) trainableNF) rr`rra experimentalrrrconvert_to_tensorr;Variable stop_gradient)rrrr tf_tensorr>r>r? xp2tensorflows&     rrcCsjddlm}tt|r!t||r|Stjj |}t |St||s*|dur.|St |S)zConvert a Tensorflow tensor to numpy or cupy tensor depending on the `ops` parameter. If `ops` is `None`, the type of the resultant tensor will be determined by the source tensor's device. rrN) rrrrcr8rBrarrrrrr)rr<rrr>r>r? tensorflow2xps  rz mx.nd.NDArraycCsBtt|dr|}tj|}ntj|}|r||S)z1Convert a numpy or cupy tensor to a MXNet tensor.r)rr`rrdrerr attach_grad)rrr mx_tensorr>r>r?xp2mxnets  rrcCshddlm}tt|rt||r|St|St||s'|dur-|St |S)z1Convert a MXNet tensor to a numpy or cupy tensor.rrN) rrrrjr8rasnumpyrto_dlpack_for_writerr)rr<rr>r>r?mxnet2xps     rPartialTfunc.argskwargscOs$tj|g|Ri|}|j|_|S)znWrapper around functools.partial that retains docstrings and can include other workarounds if needed. ) functoolspartial__doc__)rrr partial_funcr>r>r?rsrc@sNeZdZgfdedededeeeeefee eeffddf ddZ dS) DataValidationErrornamerrerrorsr-Nc Csd|d}dt|dt|}g}|D]}ddd|dgD} || |d fq||t|g} t|d d | d S) z8Custom error for validating inputs / outputs at runtime.zData validation error in ''zX: z Y: z -> cSsg|]}t|qSr>)strrpr>r>r?rsz0DataValidationError.__init__..locmsgz  N)rDjoinrkappendrr4__init__) selfrrrrmessage type_informerrorerr_locresultr>r>r?rs zDataValidationError.__init__) __name__ __module__ __qualname__rrr r rrrrr>r>r>r?rs"rrc Csrt|}tjj}t|j}t|dkr7t|dddd|Dd}d|}t |||d|igd S) zValidate the input and output of a forward function against the type annotations, if available. Used in Model.initialize with the input and output samples as they pass through the network. z (z, cSsg|]}|jqSr>)rrr>r>r?r.sz-validate_fwd_input_output..)zJInvalid forward function. Expected 3 arguments (model, X , is_train), got rN) inspect signature Signatureemptyr parametersvaluesrrr) rrrrsigrparams bad_paramsrr>r>r?validate_fwd_input_output#s  $ rrccs.tj|dd}|V|t|jdS)NF)modedelete)tempfileNamedTemporaryFilecloseosremover)rfr>r>r? make_tempfileOs r ccsRtt}t|dVt|WddS1s"wYdSrG) threadingLockr"rkset) validationprevr>r>r?data_validationWs   "rrid_colorccs6trtjj||dVtjjdSdVdS)zxContext manager to register the executed code as an NVTX range. The ranges can be used as markers in CUDA profiling.N)rrr9nvtx RangePushRangePop)rrr>r>r?use_nvtx_range`s  rc@sFeZdZUdZejed<ejed<ede fddZ de fddZ d S) ArrayInfoz4Container for info for checking array compatibility.rrrEcCs||j|jdS)Nrrr)clsrEr>r>r? from_arraysrUzArrayInfo.from_arraycCsL|j|jkrtd|jd|j|j|jkr$td|jd|jdS)NzShape mismatch in backprop. Y: z, dY: zType mismatch in backprop. Y: )rr4r)rrEr>r>r?check_consistencyws  zArrayInfo.check_consistencyN) rrrrr%Shape__annotations__DTypes classmethodr'rrr>r>r>r?rls   r)rFr@rPrCrArsryrxrrrrrrrrrr rrrr)r-r.)rrG)r-N)FN)FF)F)r)r)o contextlibrrr r{rJrr  contextvarsr dataclassesrtypingrrrrrr r r r r rrBpackaging.versionrpydanticrrrwasabircompatrrrrrrrrrrrrdr rar!r"boolrr$r%r&r'r(r)r*r+rr,r@rFrHrrPrTrCrArZr\r^r]rbrcrgrjrnrsrvryrxrfloatrrrrrrrrrrrrrrrr4rrrcontextmanagerr rrr__all__r>r>r>r?sF   4  0               )                 ,