o i"@sddlZddlmZddlmZmZmZddlZddlm Z m Z m Z m Z m Z ddlmZddlmZddlmZdd lmZdd lmZdd lmZd d lmZmZmZmZmZmZm Z ej!dddddedddddedddedddddedddddeddd d!dedd"d#d$dedd%d&d'dedd(d)d*dedd+d,d-dedd.d/d0dedd1d2d3ded4d5d6d7df d8ej"d9ed:e#d;e#de$d?e$d@e$dAe$dBe$dCe$dDe%fdEdFZ&ddGdHeee#effdIdJZ'dKdLZ(dWdNe#fdOdPZ)dQdRZ*dSdTZ+dUdVZ,dS)XN)Path)AnyDictOptional)Modeldata_validationfix_random_seedset_dropout_rateset_gpu_allocator)msg)Example)resolve_dot_names)util)ConfigSchemaTraining)registry)ArgOpt debug_cliparse_config_overrides setup_gpushow_validation_errorstring_to_listmodelT)allow_extra_argsignore_unknown_options)context_settings.zPath to config file)helpexists allow_dashzDName of the pipeline component of which the model should be analysed)rz--layersz-lz+Comma-separated names of layer IDs to printFz --dimensionsz-DIMzShow dimensionsz --parametersz-PARzShow parametersz --gradientsz-GRADzShow gradientsz --attributesz-ATTRzShow attributesz --print-step0z-P0zPrint model before trainingz --print-step1z-P1z Print model after initializationz --print-step2z-P2zPrint model after trainingz --print-step3z-P3zPrint final predictionsz--gpu-idz-gzGPU ID or -1 for CPUctx config_path componentlayers dimensions parameters gradients attributesP0P1P2P3use_gpuc  Cs,t| t|dd}||||||| | | d } t|j}t|tj||dd}Wdn1s2wY|}|dd}| d krK|rKt|t|t |}|j }t j |dt d }Wdn1smwY|d }|durtd |t|||}t||||| d dS)z Analyze a Thinc model implementation. Includes checks for internal structure and activations during training. DOCS: https://spacy.io/api/cli#debug-model T)intify) r'r(r)r*r&print_before_trainingprint_after_initprint_after_trainingprint_predictionF) overrides interpolateNtraining gpu_allocatorr)schemaseedzFixing random seed: print_settings)rrrargsrr load_configr6r load_model_from_configconfigrresolverr inforget_pipe debug_model)r#r$r%r&r'r(r)r*r+r,r-r.r/r<config_overrides raw_configr@ allocatornlpTr:piperKI/home/ubuntu/.local/lib/python3.10/site-packages/spacy/cli/debug_model.pydebug_model_cli sB        rMr;r<c st|dstjd|ddd|j}t|ts%tjdt|ddd|dur+i}td|j| d rCt d t ||t d z9|d g}t t||\fd dWdn1slwYtdttdWnKtyz1td|dt ddtDfddWdn1swYtdWntytjdddYnwYnwWdn1swY| drt dt ||t|dd}|drd|djvrd}|drd|djvrd}tdD]}|r(||q| d r?t d!t |||d"dD} | d#r[t d$tt| t d%dS)&NrzThe component 'z0' does not specify an object that holds a Model.r)exitsz1Requires a Thinc Model to be analysed, but found z instead.zAnalysing model with ID r1zSTEP 0 - before trainingF train_corpuscsSNrKrK)rHrOrKrLszdebug_model..z/Initialized the model with the training corpus.)nOrcSsg|]}t|iqSrK)r from_dict).0xrKrKrL szdebug_model..csSrPrKrK)examplesrKrLrQsz&Initialized the model with dummy data.zjCould not initialize the model: you'll have to provide a valid 'train_corpus' argument in the config file.r2zSTEP 1 - after initializationg?tok2vecztok2vec-listenerztransformer-listener transformerr3zSTEP 2 - after trainingcSsg|]}|jqSrK) predicted)rVexrKrKrLrXsr4zSTEP 3 - predictionz/Successfully ended analysis - model looks good.)!hasattrr failr isinstancertyperBidgetdivider _print_modelrrr initializelist itertoolsislice ValueError_set_output_dim _get_docs Exceptionr has_refget_refnamerCrangeupdatepredictstrgood) r@resolved_train_configrHrJr<r dot_namesupstream_componente predictionrK)rYrHrOrLrD^s                           rDcCsgdS)N)z6Apple is looking at buying U.K. startup for $1 billionz>Autonomous cars shift insurance liability toward manufacturersz8San Francisco considers banning sidewalk delivery robotsz+London is a big city in the United Kingdom.rKrKrKrKrL _sentencessr|enlangcCst|}t|tSrP)rget_lang_classrhrJr|)r~rHrKrKrLrms rmcCsV|ddur |d||dr'|dddur)|dd|dSdSdS)NrT output_layer)has_dimset_dimrorp)rrTrKrKrLrls  rlc Cs|dd}|dd}|dd}|dd}|dd}t|D]\}}|r.||vrtd|d |jd |jd |rU|jD]} td | d || qD|r|j D](} | | rtt | | } td| d | qZtd| d | | qZ|r|j D](} | | rt || } td| d | qtd| d | | q|r|j} | D]\} } td| d | qq$dS)Nr&r!r(Fr'r)r*zLayer z : model ID z: ''z - dim z: z - param z - grad z - attr )rd enumeratewalkr rBrcrq dim_names maybe_get_dim param_names has_param _print_matrix get_paramhas_gradget_gradattrsitems) rr<r&r(r'r)r*inoderq print_valuervaluerKrKrLrfs:      "     rfcCs`|dus t|tr |St|jd}|}t|jdD]}|d}q|dd}|t|}|S)Nz - sample: rrrR)raboolrushaperrndim)rresult sample_matrixdrKrKrLrs   r)r})-ripathlibrtypingrrrtyper thinc.apirrrr r wasabir spacy.trainingr spacy.utilr r!rschemasrr_utilrrrrrrrcommandContextrurintrMrDr|rmrlrfrrKrKrKrLs       $        @ R  "