o پi)@sddlZddlZddlZddlZddlmZmZddlZe ej ddZ e dkr7ddl mZmZmZmZn ddlmZmZmZmZeedr`z ddlZeWn ey_edYnwGdd d Zd d ZdS) N)CallableOptional.)_calculate_shapes_parse_gufunc_signature_parse_input_dimensions_update_dim_sizes __IPYTHON__zdCouldn't patch nest_asyncio because it's not installed. Running in the notebook might be have issuesc@sXeZdZdZddedeefddZddZd d Z d d Z d dZ ddZ ddZ dS) vectorizeaReturns an object that acts like a function but takes arrays as an input. The vectorized function evaluates `func` over successive tuples of the input chararrays and returns a single NumPy chararrays or a tuple of NumPy chararrays. Its behavior is similar to NumPy's `vectorize` for Python functions: the function being vectorized is executed in a `for` loop. Coroutines, however, are executed concurrently. Part of the code was adapted from `numpy.lib.function_base`. Nfunc signaturecCsD||_||_t||_t|||durt||_dSd|_dSN) r r inspectiscoroutinefunctionis_coroutine_fn functoolsupdate_wrapperr_in_and_out_core_dimensions)selfr r rA/home/ubuntu/.local/lib/python3.10/site-packages/outlines/base.py__init__5s   zvectorize.__init__cOs:|s|s|S|jdur|j|i|S|j|i|S)zCall the vectorized function.N) call_thunkr call_with_signaturecall_no_signature)rargskwargsrrr__call__Cs  zvectorize.__call__cCsB|jrt}z||}W||S|w|}|S)zeCall a vectorized thunk. Thunks have no arguments and can thus be called directly. )rasyncionew_event_looprun_until_completer close)rloopoutputsrrrrLs zvectorize.call_thunkcsdd|D}dd|D}tjg|t|Rjfdd|D}fdd|D}|jr>|||}n|||}dd|D}t fddt |D}t d d|D}t t|}|d krp|d S|S) aCall functions and coroutines when no signature is specified. When no signature is specified we assume that all of the function's inputs and outputs are scalars (core dimension of zero). We first broadcast the input arrays, then iteratively apply the function over the elements of the broadcasted arrays and finally reshape the results to match the input shape. Functions are executed in a for loop, coroutines are executed concurrently. cSg|]}t|qSrnparray.0argrrr kz/vectorize.call_no_signature..cSi|] \}}|t|qSrr&r*keyvaluerrr lz/vectorize.call_no_signature..csg|]}t|qSrr' broadcast_tor)broadcast_shaperrr,psci|] \}}|t|qSrr4r/r6rrr2q cS g|] }t|tr |n|fqSr isinstancetupler*resultsrrrr,~cs g|] }t|qSr)r'asarrayreshapesqueezer*xr6rrr,s cS&g|]}t|dkr|n|qSrr'ndimitemrDrrrr,&r) itemsr' broadcastlistvaluesshapervectorize_call_coroutinevectorize_callr=ziplen)rrrr$ n_resultsrr6rr]s&  zvectorize.call_no_signaturecs|j\}}t|t|}|t|krtdt|t|fdd|D}dd|D}t|t||\}t||}ddt||D}fdd|D}t|}|j rf| ||} n| ||} dd| D} tt| } t| } || krt d |d | t| |D]\} } | D]}t ||| qqt||}td dt|t| D} td d| D} | d kr| dS| S)z.cSr.rr&r/rrrr2r3z1vectorize.call_with_signature..cSs g|] \}}tj||ddqS)T)subokr4)r*r+rQrrrr,scr8rr4r/r6rrr2r9cSr:rr;r>rrrr,r@z4wrong number of outputs from the function, expected z, got cSs$g|]\}}t||qSr)r'hstackrBrC)r*rQr?rrrr,scSrFrGrHrDrrrr,rKrLr)rrU TypeErrorrMrrOrPrrTrrRrS ValueErrorr r=)rrrinput_core_dimsoutput_core_dimsnum_args dim_sizes input_shapesn_outr$ flat_outputsrVr? core_dimsresultshapesrr6rrsZ       zvectorize.call_with_signaturecsZg}tj|D]#tfdd|D}fdd|D}||j|i|q|S)aeRun the function in a for loop. A possible extension would be to parallelize the calls. Parameters ---------- broadcast_shape The brodcast shape of the input arrays. args The function's broadcasted arguments. kwargs The function's broadcasted keyword arguments. c3|]}|VqdSrrr)indexrr z+vectorize.vectorize_call..ci|] \}}||qSrrr/rfrrr2z,vectorize.vectorize_call..)r'ndindexr=rMappendr )rr7rrr$ current_argscurrent_kwargsrrfrrSs zvectorize.vectorize_callcs@fdd}t}z ||}W||S|w)ayRun coroutines concurrently. Creates as many tasks as needed and executes them in a new event loop. Parameters ---------- broadcast_shape The brodcast shape of the input arrays. args The function's broadcasted arguments. kwargs The function's broadcasted keyword arguments. cslg}tjD]#tfddD}fddD}|j|i|qtj|IdH}|S)Nc3rerrr)rfrrrhrizVvectorize.vectorize_call_coroutine..create_and_gather_tasks..crjrrr/rfrrr2rkzWvectorize.vectorize_call_coroutine..create_and_gather_tasks..)r'rlr=rMrmr rgather)tasksrnror$rr7rrrfrcreate_and_gather_tasksszCvectorize.vectorize_call_coroutine..create_and_gather_tasks)rr r!r")rr7rrrsr#r$rrrrrRs  z"vectorize.vectorize_call_coroutiner)__name__ __module__ __qualname____doc__rrstrrrrrrrSrRrrrrr 's  -K r cCs\g}t||D]"\}}|jjtjkr$|jt|jkr$|t|j}||qt|S)a(Update the dtype of arrays. String arrays contain strings of fixed length. Here they are initialized with the type of the first results, so that if the next results contain longer strings they will be truncated when added to the output arrays. Here we update the type if the current results contain longer strings than in the current output array. Parameters ---------- arrays Arrays that contain the vectorized function's results. results The current output of the function being vectorized. ) rTdtypetyper'str_r(astypermr=)arraysr?updated_arraysr(rcrrr_update_arrays_types r)rbuiltinsrrtypingrrnumpyr'int __version__splitnp_major_versionnumpy.lib._function_base_implrrrr numpy.lib.function_basehasattr nest_asyncioapply ImportErrorprintr rrrrrs,    k