o ier@sdZddlZddlZddlZddlmZmZmZddlm Z m Z ddl m Z ddl m Z mZmZddlmZddlmZdd lmZmZmZdd lmZdd lmZmZdd lmZdd lm Z ddl!m"Z"m#Z#m$Z%e GdddZ&e GdddZ'e GdddZ(GdddZ)          djde*d ee*d!e*d"e*d#e+d$ee,d%e+d&e+d'e+d(e*d)e-d*e'fd+d,Z.d-gd.fde*d e*d/ee*d0ee*d$e,d*ee*e'ff d1d2Z/e0d3krddl1Z1e1j2d4d5Z3e3j4dd6d7e3j4d8d9d:d7e3j4d;de3j4d?d@dgdAdBdCe3j4dDe+ddEdFe3j4dGdHdIdJe3j4dKdLe,dMdNe3j4dOdPe+ddQdFe3j4dRe+ddSdFe3j4dTe+ddUdFe3j4dVdWddXd>e35Z6e.e6j7e6j8e6j9e6j:e6j;e6je6j?e6j@e6jA dY ZBeCdZd[eCd\eCd[eCd]eBj7eCd^eBj8eCd_eBj9d`eBjDdaeCdbeBjEeCdceBjFeCddeBjGdedfeCdgeBjHdedfeCdheBjIeBjJreCdieBjJdSdSdS)ka Main transcription pipeline orchestrating the full workflow: 1. Download audio segments from R2 2. Fetch language info from Supabase 3. Process/split audio segments 4. Transcribe using Gemini 5. Output results Full control over all parameters for testing and production use. N)OptionalListDict) dataclassfield)datetime)DEFAULT_SETTINGS GEMINI_MODELSget_model_name)download_video_segments)get_video_language)AudioProcessor AudioChunkget_segment_stats) AudioPolisher)GeminiTranscriberTranscriptionConfig)TranscriptionResult)derive_romanized_text)validate_transcriptionquick_validatecleanupc@sPeZdZUdZeed<dZeeed<dZeed<dZ e ed<d Z e ed <d Z e ed <d Z e ed<dZeeed<dZeed<dZeed<dZeed<dZeeed<d Ze ed<dZeed<dZeed<dZeed<dZeed<dZe ed <d!Zeed"<dZeed#<d$Zeed%<dZeed&<ed'd(d)Z eed*<d+Z!eed,<dZ"eed-<dS).PipelineConfigzq Complete configuration for the transcription pipeline. All parameters are exposed for full control. video_idNlanguageTelugudefault_language$@max_segment_duration_sec@min_segment_duration_secchunk_overlap_secT@split_boundary_padding_ms max_segmentsrsegment_start_indexTskip_short_segmentsgemini-3-flash-previewmodellowthinking_level temperaturevalidate_transcriptionsretryvalidation_actionzgemini-3-pro-preview retry_modelretry_thinking_levelg@ min_snr_db./transcriptions output_dirsave_intermediate batch_size polish_audiocCstdS)Nwork_dir)rr:r: pipeline.pyKszPipelineConfig.)default_factoryr9F cleanup_afteruse_regex_fallback)#__name__ __module__ __qualname____doc__str__annotations__rrrrfloatr r"r$r%intr&r'boolr)r+r,r-r/r0r1r2r4r5r7r8rr9r>r?r:r:r:r;r s6                    rc@seZdZUdZeed<eed<eed<eeed<eed<eed<eed<eed <eed <eed <eed <e eed <eed<eed<dS)PipelineResultzResults from a pipeline run.rrr)r+total_segments_foundsegments_processedchunks_createdtranscriptions_completedtotal_audio_duration_sectotal_processing_time_sec output_fileerrors started_at completed_atN) r@rArBrCrDrErrGrFrr:r:r:r;rIPs    rIc@seZdZUdZdZeed<dZeed<dZeed<dZ eed<dZ eed<dZ eed<dZ eed <dZ eed <dZeed <dZeed <d Zeed<dZdZdZdZddZddZdS) _BatchHealthz>Tracks validator health per batch. Catches silent degradation.r validated ctc_success mms_success dual_successone_sided_acceptacceptreviewr.rejectretry_improvedr!total_combinedg?g333333?g?cCs|jd7_|jdk}|jdk}|r|jd7_|r#|jd7_|r.|r.|jd7_|jdkr>|r7|s>|jd7_|j}t||rQt ||t ||d|j |j 7_ dS)zRecord one validation result.rrZN) rUnative_ctc_scoreroman_mms_scorerVrWrXstatusrYhasattrsetattrgetattrr^combined_score)self validationctc_okmms_ok status_attrr:r:r;record|s   z_BatchHealth.recordc Cst|jd}|j|}|j|}|j|}|j|}|j|}|jt|jd}|d|jd|jd|j d|j d|jd|d |d |d d |d d |d d |j|j dkre|d|j g} |d|j krz| dd|d d|d|jkr| dd|d d||jkr| d|d d|jd |jdkr||jkr| d|d d|jd | D] } |d| dq| S)z5Log batch health summary. Warn on threshold breaches.r_z Health: z validated | accept=z review=z retry=z reject=z | avg_S=z.3fz Validators: CTC=z.0%z MMS=z dual=z | one-sided accepts=rz Retries improved: zCTC failing on z of segmentszMMS failing on z Reject rate z exceeds zOne-sided accept rate z ALERT: WARN)maxrUr^rVrWrXr\rYrZr[r.r]CTC_FAIL_THRESHOLDappendMMS_FAIL_THRESHOLDREJECT_THRESHOLDONE_SIDED_THRESHOLD) rglog_fnnavg_sctc_ratemms_rate dual_raterej_rateone_sided_ratealertsalertr:r:r;reportsR          z_BatchHealth.reportN)r@rArBrCrUrGrErVrWrXrYrZr[r.r\r]r^rFrorqrrrsrlr~r:r:r:r;rTgs&             rTc@sfeZdZdZdefddZddedefdd Zd ed efd d Zd e fddZ dde d efddZ dS)TranscriptionPipelinezF Main pipeline orchestrating the full transcription workflow. configcCs"||_g|_g|_d|_g|_dS)z'Initialize pipeline with configuration.N)rresultsrQ start_time_health_alerts)rgrr:r:r;__init__s  zTranscriptionPipeline.__init__INFOmessagelevelcCs,td}td|d|d|dS)zLog a message with timestamp.z%H:%M:%S[z] [z] N)rnowstrftimeprint)rgrr timestampr:r:r;_logszTranscriptionPipeline._logrreturnc Cs*ddddddddd d d d d }||dS)z-Convert language name to code for validation.tehitaknmlbnmrgupaorasen) rHindiTamilKannada MalayalamBengaliMarathiGujaratiPunjabiOdiaAssameseEnglish)get)rgrlang_mapr:r:r;_get_language_codes  z(TranscriptionPipeline._get_language_codec(st_t}djjdjjdjj dzt jjjj jj d\}}Wnt yY}zjd|d|dd }~wwt|}d |d d d |dd dd|dd d krd|dd|dd d krd|ddddjjrjj}d|ntjjjjd}d|dtjjjjjjjjd}|j|jjjjdjjd krjjd djjdtd jjrd!t }t!j"#|d"} d } d } g} D]:} |j$| j%| d#}|j&r4|j'| _%| d$7} |j(jj)krB| d$7} q|j*d%jjkrR| d$7} q| | qd&| d'td(t| d)| d krd*| d+jj)d,| d-td.t+}t,jjjj jj-|d/}t.d tjj/D]t0jj/t}|d0d$d1|d2t|j1|fd3d4d5}jj2r/3|}t4}t5|D]2\}}|j6r!t7|j6||j8j9pd6d7}|j:|j8_9t;|j%|j6|j:|jjd8}|j<|_=|j>|_?|jd>d?dt,jjBjjCjj-|d/}|D|j%|}|d@sd dAlEmF}mG}|dB}tH|tIr{|d^i|nd }||dCd6|dDd6|dEd6|dFd6||dGd6dH}t7|j8||j9pd6d7}|j:|_9t;|j%|j8|j:|jjd8} | j>|j>kr||_8|j|_J|j |_ | }dI| j>d>dJ| j<d?|jKd$7_Kn dK| j>d>|j<|_=|j>|_?|jd>dO|jLd>dP|jMd>d? d|N|q|Oj}!jPQ|!jRQ|jjSr@jTdQdRqdSjTdTdR}"jj2rUtUjjVrzdUd d lW}#t!j"#jj jj}$t!j"X|$rz|#Y|$tj}%t}&tZdVdWjRD}'t[jj|jjjj |d d tt\dXdWjRDttjR|'|%|"j||&dY}dZ|%ddd[|'dd\d]|"|S)_z} Execute the full pipeline. Returns: PipelineResult with summary and statistics zStarting pipeline for video: Model: z , Thinking: z-Step 1: Downloading audio segments from R2...)r9r?zR2 download failed: zERROR: ERRORNzFound total_filesrz audio files, total duration: total_duration_sec.1fsover_10s_countz -> z segments over 10s will be splitunder_2s_countz! segments under 2s may be skippedrmz!Step 2: Fetching language info...zUsing specified language: )defaultzLanguage from Supabase: z$Step 3: Processing audio segments...)max_duration_secmin_duration_sec overlap_secboundary_padding_ms)r% skip_shortzStarting from index z, z chunks remainingz'Step 3.5: Polishing audio boundaries...polished)r4r_g@@z Polished /z chunks (z already clean)zSNR gate: skipped z chunks (SNR < zdB)zStep 4: Transcribing z chunks...)r)r+r,rzProcessing batch -z of c s.d|dtd|djS)Nz Chunk r: r_)rlenoriginal_segment)ctbatch batch_startchunksrgr:r;r<Is  z+TranscriptionPipeline.run..)progress_callback) native_textrfallback_romanized)romanized_textrr)r.r\r.z Retrying z with z (S=z.2f)error)TranscriptionOutput SpeakerMetaspeaker transcription code_switch romanizedtaggeddetected_language)rrrrrrz Retry improved: S=z (z Retry did not improve: S=)r\r.z Validation: z -> z, CTC=z, MMS=T)partialzStep 5: Saving results...FzCleaning up downloaded files...cs|]}|jVqdSN duration_sec.0rr:r:r; z,TranscriptionPipeline.run..csrr) segment_idrr:r:r;rr)rrr)r+rJrKrLrMrNrOrPrQrRrSzPipeline completed in z Transcribed z s of audiozOutput saved to: r:)]timerrr isoformatrrrr)r+r r9r? ExceptionrQrprrrr rr rr r"r$process_segments_directoryr%r'r&rr8rospathjoinpolish file_path was_modified output_pathsnr_dbr2polished_duration_msrrr,ranger7mintranscribe_batchr-rrT enumeratenativerrrtextrrbvalidation_statusrfvalidation_scorer/rr0r1transcribe_audio src.backend.transcription_schemarr isinstancedict model_usedr]r`rarlr~rextendrr5 _save_resultscleanup_validatorr>shutilexistsrmtreesumrIset)(rgrR segments_dirmetadataestatsr processorpolisher polished_dirpolished_count snr_skippedsurviving_chunkschunkresult transcribertranscription_config batch_end batch_results lang_code batch_healthiromanized_resultrh retry_config retry_rawrr speaker_datar retry_outputretry_romanized retry_valr|rPrvideo_work_dir total_timerS total_audior:rr;runs              $                              zTranscriptionPipeline.runFrc Cs"tj|jjddtd}|rdnd}|jjd|jj ddd||d}tj |jj|}|jj|jj|jj |j rF|j d jn|jj|jj|jj|jj|jjd t|j td d |j Dd d|j Dd}t|ddd}tj||dddWd|S1swY|S)zSave results to JSON file.T)exist_okz %Y%m%d_%H%M%S_partialr_rz.jsonr)rr r$r%csrrrrr:r:r;rrz6TranscriptionPipeline._save_results..cSsg|]}|qSr:) model_dumprr:r:r; sz7TranscriptionPipeline._save_results..)rr)r+rr results_countrrwzutf-8)encodingF) ensure_asciiindentN)rmakedirsrr4rrrrr)replacerrr+rrrrr r$r%rropenjsondump)rgrrsuffixfilenamer output_datafr:r:r;rs0 * z#TranscriptionPipeline._save_resultsN)r)F) r@rArBrCrrrDrrrIrrHrr:r:r:r;rs rr(r*r!rrr#r3Trrr)r+r,r%rr split_pad_msr4validaterc Cs.t|||||||||| | d } t| } | S)a Convenience function to run the pipeline with common settings. Args: video_id: YouTube video ID language: Primary language (if None, fetched from Supabase) model: Gemini model to use thinking_level: Thinking level for Gemini 3 (default: low) temperature: Generation temperature (default: 0.0 deterministic) max_segments: Limit segments for testing max_duration_sec: Max segment duration (hard limit) min_duration_sec: Skip segments shorter than this duration split_pad_ms: Padding context to add around split boundaries output_dir: Directory for output files validate: Whether to validate transcriptions Returns: PipelineResult with summary ) rrr)r+r,r%rr r$r4r-)rrr) rrr)r+r,r%rrr1r4r2rpipeliner:r:r; run_pipeline s r4highmodelsthinking_levelsc Csi}|D]P}|D]K}|d|}tddtd|tdzt|||||d|d} | ||<WqtyS} ztd|d| WYd } ~ qd } ~ wwq|S) ae Test multiple models on the same video for comparison. Args: video_id: Video ID to test language: Primary language models: List of model names to test thinking_levels: Thinking levels to try max_segments: Segments per test Returns: Dict mapping model_thinking to PipelineResult r <============================================================z Testing: z./transcriptions/test_)rrr)r+r%r4zERROR testing rN)rr4r) rrr7r8r%rr)thinkingkeyr rr:r:r; test_models?s.   r=__main__zTranscription Pipeline) descriptionzYouTube video ID)helpz --languagez-lz'Primary language (default: auto-detect)z--modelz-mzGemini model to use)rr@z --thinkingz-t)minimalr*mediumr5z*Thinking level for Gemini 3 (default: low))rchoicesr@z --temperaturez3Generation temperature (default: 0.0 deterministic))typerr@z --no-validate store_truezSkip transcription validation)actionr@z--max-segmentsz-nzMaximum segments to process)rDr@z--max-durationz-dz#Maximum segment duration in secondsz--min-durationz2Minimum segment duration in seconds (default: 2.0)z--split-pad-msz8Padding (ms) added around split boundaries (default: 80)z--outputz-ozOutput directory) rrr)r+r,r%rrr1r4r2r9r:zPipeline Summaryz Video ID: z Language: rz (thinking: rzSegments processed: zChunks transcribed: z Total audio: rrz Total time: zOutput: zErrors: ) Nr(r*r!Nrrr#r3T)KrCrr+rtypingrrr dataclassesrrrsrc.backend.configrr r src.backend.r2_storager src.backend.supabase_clientr src.backend.audio_processorr rrsrc.backend.audio_polisherrsrc.backend.gemini_transcriberrrrrsrc.romanizationrsrc.validatorsrrrrrrIrTrrDrFrGrHr4r=r@argparseArgumentParserparser add_argument parse_argsargsrrr)r;r,r% max_duration min_durationr1output no_validater rr+rKrMrNrOrPrQr:r:r:r;s       /L]    6  -          5