o $i4@sddlZddlZddlmZddlmZmZddlm Z ddl m Z m Z m Z mZmZeeZGdddeZGdd d eZGd d d ejZd d ZddZddZedejejBZddZdS)N)sync)aggregation_data base_exporter)start_http_server)REGISTRYCounterMetricFamilyGaugeMetricFamilyHistogramMetricFamilyUnknownMetricFamilyc@sReZdZdZdddefddZeddZedd Zed d Z ed d Z dS)OptionsaOptions contains options for configuring the exporter. The address can be empty as the prometheus client will assume it's localhost :type namespace: str :param namespace: The prometheus namespace to be used. Defaults to ''. :type port: int :param port: The Prometheus port to be used. Defaults to 8000. :type address: str :param address: The Prometheus address to be used. Defaults to ''. :type registry: registry :param registry: The Prometheus address to be used. Defaults to ''. :type registry: :class:`~prometheus_client.core.CollectorRegistry` :param registry: A Prometheus collector registry instance. i@cCs ||_||_t||_||_dSN) _namespace _registryint_port_address)self namespaceportaddressregistryr]/home/ubuntu/veenaModal/venv/lib/python3.10/site-packages/ray/_private/prometheus_exporter.py__init__'s  zOptions.__init__cC|jSz&Prometheus Collector Registry instancerrrrrr-zOptions.registrycCr)z Prefix to be used with view name)rrrrrr2rzOptions.namespacecCr)zPort number to listen)rrrrrr7rz Options.portcCr)z'Endpoint address (default is localhost))rrrrrr<rzOptions.addressN) __name__ __module__ __qualname____doc__rrpropertyrrrrrrrrr s   r c@speZdZdZedfddZeddZeddZed d Z ed d Z d dZ ddZ ddZ ddZdS) Collectorz4Collector represents the Prometheus Collector objectNcCs*|duri}||_|j|_||_i|_dSr )_optionsrr_view_name_to_data_map_registered_views)roptionsview_name_to_data_maprrrrEs  zCollector.__init__cCrz,Options to be used to configure the exporterr&rrrrr)MrzCollector.optionscCrrrrrrrrRrzCollector.registrycCr)zOMap with all view data objects that will be sent to Prometheus )r'rrrrr*WzCollector.view_name_to_data_mapcCr)zMap with all registered views)r(rrrrregistered_views^rzCollector.registered_viewscCsJt|jj|}||jvr#||jttt|j|j j d}||j|<dSdS)zrregister_view will create the needed structure in order to be able to sent all data to Prometheus )name documentationlabelsunitsN) get_view_namer)rr. descriptionlistmapsanitizecolumnsmeasureunit)rviewv_namedescrrr register_viewcs zCollector.register_viewcCs*||jt|jj|j}||j|<dS)z)Add view data object to be sent to serverN)r>r;r3r)rr*)r view_datar<rrr add_view_datars zCollector.add_view_datacCs|d}|d}|d}|d}t|t|ksJ||fdd|D}t|tjrH||} | s>t||||d} | ||<| j||jdd St|tjr|j t |j ksXJg} d } t |j D]\} } | |j | 7} t | | g}| |qa| d |jg||} | st|||d } | ||<| j|| |jd d St|tjr||} | st|||d } | ||<| j||jdd St|tjr||} | st|||d } | ||<| j||jdd Stdt|)ato_metric translate the data that OpenCensus create to Prometheus format, using Prometheus Metric object :type desc: dict :param desc: The map that describes view definition :type tag_values: tuple of :class: `~opencensus.tags.tag_value.TagValue` :param object of opencensus.tags.tag_value.TagValue: TagValue object used as label values :type agg_data: object of :class: `~opencensus.stats.aggregation_data.AggregationData` :param object of opencensus.stats.aggregation_data.AggregationData: Aggregated data that needs to be converted as Prometheus samples :rtype: :class:`~prometheus_client.core.CounterMetricFamily` or :class:`~prometheus_client.core.HistogramMetricFamily` or :class:`~prometheus_client.core.UnknownMetricFamily` or :class:`~prometheus_client.core.GaugeMetricFamily` r/r0r1r2cSsg|]}|r|ndqS)r r).0tvrrr sz'Collector.to_metric..)r/r0r:r1)r1valueNrz+Inf)r/r0r1)r1buckets sum_valuezunsupported aggregation type )len isinstanceaggregation_data_moduleCountAggregationDatagetr add_metric count_dataDistributionAggregationDataboundssorted enumeratecounts_per_bucketstrappendr sumSumAggregationDatar sum_dataLastValueAggregationDatarrD ValueErrortype)rr= tag_valuesagg_data metrics_map metric_namemetric_description label_keys metric_unitsmetricrE cum_countiiboundbucketrrr to_metricys          zCollector.to_metricccsri}|jD]"\}}||jvrq |j|}|jD]}|j|}|||||qq |D]}|Vq1dS)zCollect fetches the statistics from OpenCensus and delivers them as Prometheus Metrics. Collect is invoked every time a prometheus.Gatherer is run for example when the HTTP endpoint is invoked by Prometheus. N)r'copyitemsr.tag_value_aggregation_data_maprgvalues)rr]r<r?r=r[r\rbrrrcollects     zCollector.collect)r r!r"r#r rr$r)rr*r.r>r@rgrlrrrrr%Bs     cr%c@sreZdZdZejefddZeddZ eddZ edd Z ed d Z d d Z ddZddZddZdS)PrometheusStatsExportera^Exporter exports stats to Prometheus, users need to register the exporter as an HTTP Handler to be able to export. :type options: :class:`~opencensus.ext.prometheus.stats_exporter.Options` :param options: An options object with the parameters to instantiate the prometheus exporter. :type gatherer: :class:`~prometheus_client.core.CollectorRegistry` :param gatherer: A Prometheus collector registry instance. :type transport: :class:`opencensus.common.transports.sync.SyncTransport` or :class:`opencensus.common.transports.async_.AsyncTransport` :param transport: An instance of a Transpor to send data with. :type collector: :class:`~opencensus.ext.prometheus.stats_exporter.Collector` :param collector: An instance of the Prometheus Collector object. cCs4||_||_||_|||_|t|jdSr )r& _gatherer _collector _transport serve_httprregister)rr)gatherer transport collectorrrrrs  z PrometheusStatsExporter.__init__cCr)zOThe transport way to be sent data to server (default is sync). )rprrrrrtr-z!PrometheusStatsExporter.transportcCr)zSCollector class instance to be used to communicate with Prometheus )rorrrrrur-z!PrometheusStatsExporter.collectorcCrr)rnrrrrrsrz PrometheusStatsExporter.gatherercCrr+r,rrrrr)!rzPrometheusStatsExporter.optionscCs|dur |j|dSdS)zvexport send the data to the transport class in order to be sent to Prometheus in a sync or async way. N)rtexport)rr?rrrrv&szPrometheusStatsExporter.exportcCstdS)NzNot supported by Prometheus)NotImplementedError)rr;rrron_register_view-sz(PrometheusStatsExporter.on_register_viewcCs*|D]}|jdur i|_|j|qdS)a=Emit exports to the Prometheus if view data has one or more rows. Each OpenCensus AggregationData will be converted to corresponding Prometheus Metric: SumData will be converted to Untyped Metric, CountData will be a Counter Metric DistributionData will be a Histogram Metric. N)rjrur@)rr?v_datarrremit0s  zPrometheusStatsExporter.emitcCs6t|jj}|r d|ini}tdd|jji|dS)z*serve_http serves the Prometheus endpoint.addrrNr)rSr)rrr)rrkwargsrrrrq>s z"PrometheusStatsExporter.serve_httpN)r r!r"r#r SyncTransportr%rr$rtrursr)rvrxrzrqrrrrrms       rmcCs.|jdkr tdt|}t||j|d}|S)zQnew_stats_exporter returns an exporter that exports stats to Prometheus. r z"Namespace can not be empty string.)r)rsru)rrY new_collectorrmr)optionruexporterrrrnew_stats_exporterEs rcCs t|dS)znew_collector should be used to create instance of Collector class in order to prevent the usage of constructor directly r))r%rrrrr~Ts r~cCs"d}|dkr |d}t||jS)zcreate the name for the viewr _)r7r/)rr;r/rrrr3\sr3z[^\w]cCs td|S)zsanitize the given metric name or label according to Prometheus rule. Replace all characters other than [A-Za-z0-9_] with '_'. r)_NON_LETTERS_NOR_DIGITS_REsub)keyrrrr7gs r7) loggingreopencensus.common.transportsropencensus.statsrrIrprometheus_clientrprometheus_client.corerrrr r getLoggerr loggerobjectr r% StatsExporterrmrr~r3compileUNICODE IGNORECASErr7rrrrs    +0T