o `۷i/ @sdZddlmZmZddlmZmZmZmZm Z m Z ddl m Z er.ddl mZddlmZGdddeZe d ed ZGd d d eeeZGd ddee eefZdS)z>Ranker component for operator selection in streaming executor.)ABCabstractmethod) TYPE_CHECKINGGenericListProtocolTupleTypeVar)PhysicalOperator)ResourceManager)Topologyc@sjeZdZdZdddefddZdddefddZdddefdd Zdddefd d Zdddefd d Z dS) Comparablez4Protocol for types that can be compared for ranking.otherreturncCdSNselfrrrY/home/ubuntu/vllm_env/lib/python3.10/site-packages/ray/data/_internal/execution/ranker.py__lt__zComparable.__lt__cCrrrrrrr__le__rzComparable.__le__cCrrrrrrr__gt__rzComparable.__gt__cCrrrrrrr__ge__rzComparable.__ge__cCrrrrrrr__eq__rzComparable.__eq__N) __name__ __module__ __qualname____doc__boolrrrrrrrrrr sr RankingValue)boundc @sPeZdZdZededddddefdd Zd eedddddeefd d Z d S)Rankerz4Abstract base class for operator ranking strategies.optopologyr resource_managerr rcCsdS)aRank operator for execution priority. Operator to run next is selected as the one with the *smallest* value of the lexicographically ordered ranks composed of (in order): Args: op: Operator to rank topology: Current execution topology resource_manager: Resource manager for usage information Returns: Rank (tuple) for operator Nr)rr$r%r&rrr rank_operator'szRanker.rank_operatoropscs&t|dksJfdd|DS)Nrcsg|] }|qSr)r').0r$r&rr%rr Esz)Ranker.rank_operators..)len)rr(r%r&rr*rrank_operators=szRanker.rank_operatorsN) rrrrrr r!r'rr-rrrrr#$s* r#c @s2eZdZdZdedddddeeeffdd Zd S) DefaultRankerzRanker implementation.r$r%r r&r rcCs |rdnd}|||jfS)aComputes rank for op. *Lower means better rank* 1. Whether operator's could be throttled (int) 2. Operators' object store utilization Args: op: Operator to rank topology: Current execution topology resource_manager: Resource manager for usage information Returns: Rank (tuple) for operator r)throttling_disabled get_op_usageobject_store_memory)rr$r%r&r0rrrr'Ks zDefaultRanker.rank_operatorN)rrrrr rintr'rrrrr.Hs r.N)rabcrrtypingrrrrrr 'ray.data._internal.execution.interfacesr -ray.data._internal.execution.resource_managerr 5ray.data._internal.execution.streaming_executor_stater r r!r#r3r.rrrrs      $