o wi@sdZddlZddlZddlZddlZddlZddlZddlmZddl m Z m Z GdddZ Gdd d Z Gd d d ejZdS) z"Writes events to disk in a logdir.N) event_pb2) RecordWriterdirectory_checkc@s:eZdZdZdddZddZddZd d Zd d Zd S) EventsWriterz1Writes `Event` protocol buffers to an event file.cCsx|dttdddt||_d|_t|j|_t |_ t|j _ d|j _ t |_||j dS)z{ Events files have a name of the form '/some/file/path/events.out.tfevents.[timestamp].[hostname]' z.out.tfevents.N .rz brain.Event:2)strtimesocket gethostname _file_name_num_outstanding_eventsr_py_recordio_writerrEvent_event wall_time file_version threadingLock_lock write_event)self file_prefixfilename_suffixr[/home/ubuntu/sommelier/.venv/lib/python3.10/site-packages/tensorboardX/event_file_writer.py__init__ s    zEventsWriter.__init__cCs,t|tjstdt|||S)zAppend "event" to the file.z,Expected an event_pb2.Event proto, but got ) isinstancerr TypeErrortype_write_serialized_eventSerializeToStringreventrrrr0s zEventsWriter.write_eventcCsF|j|jd7_|j|WddS1swYdS)Nr)rrrwrite)r event_strrrrr"9s"z$EventsWriter._write_serialized_eventcCs<|jd|_|jWddS1swYdS)zFlushes the event file to disk.rNT)rrrflushrrrrr(>s  zEventsWriter.flushcCs>|}|j|jWd|S1swY|S)zCall self.flush().N)r(rrclose)r return_valuerrrr*Es  zEventsWriter.closeN)r) __name__ __module__ __qualname____doc__rrr"r(r*rrrrrs   rc@sBeZdZdZdddZddZd d Zd d Zd dZddZ dS)EventFileWritera"Writes `Event` protocol buffers to an event file. The `EventFileWriter` class creates an event file in the specified directory, and asynchronously writes Event protocol buffers to the file. The Event file is encoded using the tfrecord format, which is similar to RecordIO. rxrcCs`||_t|jt||_ttj|jd||_ ||_ d|_ t |j|j ||_ |j dS)aCreates a `EventFileWriter` and an event file to write to. On construction the summary writer creates a new event file in `logdir`. This event file will contain `Event` protocol buffers, which are written to disk via the add_event method. The other arguments to the constructor control the asynchronous writes to the event file: Args: logdir: A string. Directory where event file will be written. max_queue_size: Integer. Size of the queue for pending events and summaries. flush_secs: Number. How often, in seconds, to flush the pending events and summaries to disk. eventsFN)_logdirrmultiprocessingQueue _event_queuerospathjoin _ev_writer _flush_secs_closed_EventLoggerThread_workerstart)rlogdirmax_queue_size flush_secsrrrrrUs   zEventFileWriter.__init__cCs|jS)z7Returns the directory where event file will be written.)r3r)rrr get_logdirpszEventFileWriter.get_logdircCs2|jrd|_t|j|j|j|_|jdSdS)a Reopens the EventFileWriter. Can be called after `close()` to add more events in the same directory. The events will go into a new events file and a new write/flush worker is created. Does nothing if the EventFileWriter was not closed. FN)r<r=r6r:r;r>r?r)rrrreopents zEventFileWriter.reopencCs|js |j|dSdS)zeAdds an event to the event file. Args: event: An `Event` protocol buffer. N)r<r6putr$rrr add_eventszEventFileWriter.add_eventcCs|js |jdSdS)zFlushes the event file to disk. Call this method to make sure that all pending events have been written to disk. N)r<r:r(r)rrrr(szEventFileWriter.flushcCsF|js!||j|j|jd|_d|_d|_dSdS)zPerforms a final flush of the event file to disk, stops the write/flush worker and closes the file. Call this method when you do not need the summary writer anymore. NT)r<r(r>stopr:r*r6r)rrrr*s    zEventFileWriter.closeN)rr1r) r,r-r.r/rrCrDrFr(r*rrrrr0Ms   r0c@s(eZdZdZddZddZddZdS) r=zThread that logs events.cCs<tj|d|_||_||_||_d|_d|_t |_ dS)a'Creates an _EventLoggerThread. Args: queue: A Queue from which to dequeue data. record_writer: An data writer. Used to log brain events for the visualizer. flush_secs: How often, in seconds, to flush the pending file to disk. TrFN) rThreadrdaemon_queue_record_writerr;_next_flush_time_has_pending_dataobject_shutdown_signal)rqueue record_writerrBrrrrs  z_EventLoggerThread.__init__cCs|j|j|dS)N)rJrErOr9r)rrrrGs z_EventLoggerThread.stopcCs t}|j|}d}z)|dkr|jd|}n|jd}t|t|jkr+WdS|j|d|_Wn t j y?Ynwt}||jkrZ|jrT|j d|_||j |_q)NTrF) r rLrJgetr!rOrKrrMrPEmptyr(r;)rnowqueue_wait_durationdatarrrruns,       z_EventLoggerThread.runN)r,r-r.r/rrGrWrrrrr=s  r=)r/r4r7rPr rr protorrQrrrr0rHr=rrrrs 0U