o `۷i06@sddlZddlZddlZddlmZddlmZddlmZ m Z ddl m Z ddl mZmZmZmZmZeeZGdddeZGd d d eZGd d d e jZd dZddZddZedejej BZ!ddZ"dS)N) make_server)sync)aggregation_data base_exporter) make_wsgi_app)REGISTRYCounterMetricFamilyGaugeMetricFamilyHistogramMetricFamilyUnknownMetricFamilyc@sReZdZdZdddefddZeddZedd Zed d Z ed d Z dS)OptionsaOptions contains options for configuring the exporter. The address can be empty as the prometheus client will assume it's localhost :type namespace: str :param namespace: The prometheus namespace to be used. Defaults to ''. :type port: int :param port: The Prometheus port to be used. Defaults to 8000. :type address: str :param address: The Prometheus address to be used. Defaults to ''. :type registry: registry :param registry: The Prometheus address to be used. Defaults to ''. :type registry: :class:`~prometheus_client.core.CollectorRegistry` :param registry: A Prometheus collector registry instance. i@cCs ||_||_t||_||_dSN) _namespace _registryint_port_address)self namespaceportaddressregistryrV/home/ubuntu/vllm_env/lib/python3.10/site-packages/ray/_private/prometheus_exporter.py__init__)s  zOptions.__init__cC|jSz&Prometheus Collector Registry instancerrrrrr/zOptions.registrycCr)z Prefix to be used with view name)rrrrrr4r zOptions.namespacecCr)zPort number to listenrrrrrr9r z Options.portcCr)z'Endpoint address (default is localhost))rrrrrr>r zOptions.addressN) __name__ __module__ __qualname____doc__rrpropertyrrrrrrrrr s   r c@speZdZdZedfddZeddZeddZed d Z ed d Z d dZ ddZ ddZ ddZdS) Collectorz4Collector represents the Prometheus Collector objectNcCs*|duri}||_|j|_||_i|_dSr)_optionsrr_view_name_to_data_map_registered_views)roptionsview_name_to_data_maprrrrGs  zCollector.__init__cCrz,Options to be used to configure the exporterr(rrrrr+Or zCollector.optionscCrrrrrrrrTr zCollector.registrycCr)zOMap with all view data objects that will be sent to Prometheus )r)rrrrr,YzCollector.view_name_to_data_mapcCr)zMap with all registered views)r*rrrrregistered_views`r zCollector.registered_viewscCsJt|jj|}||jvr#||jttt|j|j j d}||j|<dSdS)zrregister_view will create the needed structure in order to be able to sent all data to Prometheus )name documentationlabelsunitsN) get_view_namer+rr0 descriptionlistmapsanitizecolumnsmeasureunit)rviewv_namedescrrr register_viewes zCollector.register_viewcCs*||jt|jj|j}||j|<dS)z)Add view data object to be sent to serverN)r@r=r5r+rr,)r view_datar>rrr add_view_datats zCollector.add_view_datacCs|d}|d}|d}|d}t|t|ksJ||fdd|D}t|tjrH||} | s>t||||d} | ||<| j||jdd St|tjr|j t |j ksXJg} d } t |j D]\} } | |j | 7} t | | g}| |qa| d |jg||} | st|||d } | ||<| j|| |jd d St|tjr||} | st|||d } | ||<| j||jdd St|tjr||} | st|||d } | ||<| j||jdd Stdt|)ato_metric translate the data that OpenCensus create to Prometheus format, using Prometheus Metric object :type desc: dict :param desc: The map that describes view definition :type tag_values: tuple of :class: `~opencensus.tags.tag_value.TagValue` :param object of opencensus.tags.tag_value.TagValue: TagValue object used as label values :type agg_data: object of :class: `~opencensus.stats.aggregation_data.AggregationData` :param object of opencensus.stats.aggregation_data.AggregationData: Aggregated data that needs to be converted as Prometheus samples :rtype: :class:`~prometheus_client.core.CounterMetricFamily` or :class:`~prometheus_client.core.HistogramMetricFamily` or :class:`~prometheus_client.core.UnknownMetricFamily` or :class:`~prometheus_client.core.GaugeMetricFamily` r1r2r3r4cSsg|]}|r|ndqS)r r).0tvrrr sz'Collector.to_metric..)r1r2r<r3)r3valueNrz+Inf)r1r2r3)r3buckets sum_valuezunsupported aggregation type )len isinstanceaggregation_data_moduleCountAggregationDatagetr add_metric count_dataDistributionAggregationDataboundssorted enumeratecounts_per_bucketstrappendr sumSumAggregationDatar sum_dataLastValueAggregationDatar rF ValueErrortype)rr? tag_valuesagg_data metrics_map metric_namemetric_description label_keys metric_unitsmetricrG cum_countiiboundbucketrrr to_metric{s          zCollector.to_metricccsri}|jD]"\}}||jvrq |j|}|jD]}|j|}|||||qq |D]}|Vq1dS)zCollect fetches the statistics from OpenCensus and delivers them as Prometheus Metrics. Collect is invoked every time a prometheus.Gatherer is run for example when the HTTP endpoint is invoked by Prometheus. N)r)copyitemsr0tag_value_aggregation_data_maprivalues)rr_r>rAr?r]r^rdrrrcollects     zCollector.collect)r"r#r$r%r rr&r+rr,r0r@rBrirnrrrrr'Ds     cr'c@s~eZdZdZejefddZeddZ eddZ edd Z ed d Z ed d Z ddZddZddZddZdS)PrometheusStatsExportera^Exporter exports stats to Prometheus, users need to register the exporter as an HTTP Handler to be able to export. :type options: :class:`~opencensus.ext.prometheus.stats_exporter.Options` :param options: An options object with the parameters to instantiate the prometheus exporter. :type gatherer: :class:`~prometheus_client.core.CollectorRegistry` :param gatherer: A Prometheus collector registry instance. :type transport: :class:`opencensus.common.transports.sync.SyncTransport` or :class:`opencensus.common.transports.async_.AsyncTransport` :param transport: An instance of a Transpor to send data with. :type collector: :class:`~opencensus.ext.prometheus.stats_exporter.Collector` :param collector: An instance of the Prometheus Collector object. cCs6||_||_||_|||_||_t|jdSr)r( _gatherer _collector _transport serve_httprrregister)rr+gatherer transport collectorrrrrs   z PrometheusStatsExporter.__init__cCr)zOThe transport way to be sent data to server (default is sync). )rrrrrrrvr/z!PrometheusStatsExporter.transportcCr)zSCollector class instance to be used to communicate with Prometheus )rqrrrrrwr/z!PrometheusStatsExporter.collectorcCrr)rprrrrrur z PrometheusStatsExporter.gatherercCrr-r.rrrrr+#r zPrometheusStatsExporter.optionscCr)z)The port the HTTP server is listening on.r!rrrrr(r zPrometheusStatsExporter.portcCs|dur |j|dSdS)zvexport send the data to the transport class in order to be sent to Prometheus in a sync or async way. N)rvexport)rrArrrrx-szPrometheusStatsExporter.exportcCstdS)NzNot supported by Prometheus)NotImplementedError)rr=rrron_register_view4sz(PrometheusStatsExporter.on_register_viewcCs*|D]}|jdur i|_|j|qdS)a=Emit exports to the Prometheus if view data has one or more rows. Each OpenCensus AggregationData will be converted to corresponding Prometheus Metric: SumData will be converted to Untyped Metric, CountData will be a Counter Metric DistributionData will be a Histogram Metric. N)rlrwrB)rrAv_datarrremit7s  zPrometheusStatsExporter.emitcCsD|jjpd}t||jjt}tj|jd}d|_| |j dS)z*serve_http serves the Prometheus endpoint.r )targetT) r+rrrr threadingThread serve_foreverdaemonstartserver_address)rrhttpdtrrrrsEs  z"PrometheusStatsExporter.serve_httpN)r"r#r$r%r SyncTransportr'rr&rvrwrur+rrxrzr|rsrrrrros$       rocCs.|jdkr tdt|}t||j|d}|S)zQnew_stats_exporter returns an exporter that exports stats to Prometheus. r z"Namespace can not be empty string.)r+rurw)rr[ new_collectorror)optionrwexporterrrrnew_stats_exporterPs rcCs t|dS)znew_collector should be used to create instance of Collector class in order to prevent the usage of constructor directly r+)r'rrrrr_s rcCs"d}|dkr |d}t||jS)zcreate the name for the viewr _)r9r1)rr=r1rrrr5gsr5z[^\w]cCs td|S)zsanitize the given metric name or label according to Prometheus rule. Replace all characters other than [A-Za-z0-9_] with '_'. r)_NON_LETTERS_NOR_DIGITS_REsub)keyrrrr9rs r9)#loggingrerwsgiref.simple_serverropencensus.common.transportsropencensus.statsrrKrprometheus_clientrprometheus_client.corerrr r r getLoggerr"loggerobjectr r' StatsExporterrorrr5compileUNICODE IGNORECASErr9rrrrs$    +0]