o .i @s^UdZddlmZmZddlmZddlmZmZm Z m Z m Z er+ddl Z ddl mZe dZe dZeed fed Bed BeBZe ed < eed fed Bed BeeefBeeBeed fBeBZe ed < deedeefddZe dedgdfddddfddZe deegefdeeeefBdeeeefBfddZe deegefdeeeBdeeeBfddZe deegefdeeed fBdeeed fBfddZe deegefdeedeefddZdeegefdeddeeBfddZe deeegefdeeeefBdefddZe deeegefdeeeBdefddZe deeegefdeeed fBdefddZe deeegefdeedefd dZe deeegefdeed!edefd"dZ d&deeegefeeegefBdeed!edeeBfd#dZdeedefd$d%ZdS)'z5Helper functions to work with nested JSON structures.)CallableIterable)reduce) TYPE_CHECKINGAny TypeAliasTypeVaroverloadN)BatchedTensorInputs_T_U JSONTree[_T])r .JSONTree. _JSONTreevaluereturnccs`t|tr|D] }t|EdHq dSt|ttfr+|D] }t|EdHqdS|VdS)z5Iterate through each leaf in a nested JSON structure.N) isinstancedictvaluesjson_iter_leaveslisttuple)rvrP/home/ubuntu/veenaModal/venv/lib/python3.10/site-packages/vllm/utils/jsontree.pyr$s   rfuncz torch.Tensorr cCdSNrrrrrrjson_map_leaves0rcCrrrrrrrr7r cCrrrrrrrr>r cCrrrrrrrrEr cCrrrrrrrrLr csdt|trfdd|DSt|trfdd|DSt|tr.tfdd|DS|S)z9Apply a function to each leaf in a nested JSON structure.csi|] \}}|t|qSrr).0krrrr Ysz#json_map_leaves..csg|]}t|qSrr!r"rr$rr [sz#json_map_leaves..c3s|]}t|VqdSrr!r&r$rr ]sz"json_map_leaves..)rritemsrrrrr$rrSs   cCrrrrrrrjson_reduce_leavesbr*cCrrrrrrrr*jr+cCrrrrrrrr*rr+cCrrrrrrrr*zr+initialcCrrrrrr,rrrr*scCs&|dur t|t|St|t||S)z Apply a function of two arguments cumulatively to each leaf in a nested JSON structure, from left to right, so as to reduce the sequence to a single value. .)rrr-rrrr*s cCstddt|DS)z6Count the number of leaves in a nested JSON structure.css|]}dVqdS)Nr)r"_rrrr(sz$json_count_leaves..)sumr)rrrrjson_count_leavessr1).)__doc__collections.abcrr functoolsrtypingrrrrr torchvllm.multimodal.inputsr r r rstrrrr__annotations__rrrr*intr1rrrrs