o `Û·i£ ã@sddlmZmZddlmZddlmZmZmZm Z m Z ddl m Z m Z mZmZmZmZmZmZmZddlmZeeeeee gƒZeeeee gƒZedefdd „ƒZedefd d „ƒZGd d „d eƒZGdd„deƒZdeee ge ffdd„Zdedefdd„ZdS)é)ÚCallableÚListé)ÚRuleset)Ú LogicalPlanÚ OptimizerÚ PhysicalPlanÚPlanÚRule) ÚCombineShufflesÚ%ConfigureMapTaskMemoryUsingOutputSizeÚ FuseOperatorsÚInheritBatchFormatRuleÚInheritTargetMaxBlockSizeRuleÚLimitPushdownRuleÚPredicatePushdownÚProjectionPushdownÚSetReadParallelismRule)Ú DeveloperAPIÚreturncCótS©N)Ú_LOGICAL_RULESET©rrú[/home/ubuntu/vllm_env/lib/python3.10/site-packages/ray/data/_internal/logical/optimizers.pyÚget_logical_ruleset-órcCrr)Ú_PHYSICAL_RULESETrrrrÚget_physical_ruleset2rrc@ó&eZdZdZedeefdd„ƒZdS)ÚLogicalOptimizerz$The optimizer for logical operators.rcCódd„tƒDƒS)NcSóg|]}|ƒ‘qSrr©Ú.0Úrule_clsrrrÚ <óz*LogicalOptimizer.rules..)r©ÚselfrrrÚrules:ózLogicalOptimizer.rulesN©Ú__name__Ú __module__Ú __qualname__Ú__doc__Úpropertyrr r*rrrrr 7ór c@r)ÚPhysicalOptimizerz%The optimizer for physical operators.rcCr!)NcSr"rrr#rrrr&Dr'z+PhysicalOptimizer.rules..)rr(rrrr*Br+zPhysicalOptimizer.rulesNr,rrrrr3?r2r3cCs"ddlm}tƒj|ƒjtƒjgS)adGet the list of transformation functions to convert a logical plan to an optimized physical plan. This returns the 3 transformation steps: 1. Logical optimization 2. Planning (logical -> physical operators) 3. Physical optimization Returns: A list of transformation functions, each taking a Plan and returning a Plan. r©Úcreate_planner)Úray.data._internal.plannerr5r ÚoptimizeÚplanr3r4rrrÚget_plan_conversion_fnsGs ýr9Ú logical_plancCs,tƒ\}}}||ƒ}|j|_||ƒ}||ƒS)aGet the physical execution plan for the provided logical plan. This process has 3 steps: (1) logical optimization: optimize logical operators. (2) planning: convert logical to physical operators. (3) physical optimization: optimize physical operators. )r9ÚdagÚ_dag)r:Úoptimize_logicalr8Úoptimize_physicalÚoptimized_logical_planÚ physical_planrrrÚget_execution_plan\s rAN)ÚtypingrrÚrulesetrÚ%ray.data._internal.logical.interfacesrrrr r Ú ray.data._internal.logical.rulesr r r rrrrrrÚray.util.annotationsrrrrrr r3r9rArrrrÚs8 , ûÿ üÿ