o Ni@s`ddlmZddlZddlmZddlmZddZGdd d ej j Z Gd d d ej j Z dS) )UnionN)crf_log_likelihood)compute_dsc_losscCs6t|dkr|d|ddfSt|dkr|Std)Nrrz+Expected data to be a tuple of size 2 or 3.)len TypeError)datar H/home/ubuntu/.local/lib/python3.10/site-packages/tf2crf/model_wrapper.py unpack_data s  r cs`eZdZdZddeeefffdd Zddd Zdd d Z d d Z e ddZ ddZ ZS)ModelWithCRFLossa Wrapper around the base model for custom training logic. Args: base_model: The model including the CRF layer sparse_target: if the y label is sparse or one-hot, default True metric: the metric for training, default 'accuracy'. Warning: Currently tensorflow metrics like AUC need the output and y_true to be one-hot to cauculate, they are not supported. Taccuracymetriccsht||_||_||_t|tr%|dkr!tjj j dd|_ nt d|j|_ tjj j dd|_dSNr)namezunknown metric nameloss)super__init__ base_model sparse_targetr isinstancestrtfkerasmetricsAccuracy metrics_fn ValueErrorMean loss_tracker)selfrrr __class__r r rs  zModelWithCRFLoss.__init__FcC|r||S||dSNrrr"inputstrainingr r r call) zModelWithCRFLoss.callc Cs8|||d\}}}}t||||d }||t|fS)Nr*r)rr reduce_mean) r"xyr*viterbi_sequence potentialssequence_length chain_kernelcrf_lossr r r compute_loss/szModelWithCRFLoss.compute_lossc Cst|\}}}|jrt|jdksJntj|dd}t }|j||dd\}}}|tt |j |j } Wdn1sBwY| | |j } |jt| |j |j| |j||t||jdd|j|jj|jiSNraxisTr-rrr rrshaperargmax GradientTaper6cast reduce_sumlossesdtypegradienttrainable_variables optimizerapply_gradientszipr! update_stater sequence_maskresultr) r"r r/r0 sample_weighttaper1r3r5r gradientsr r r train_step5s  zModelWithCRFLoss.train_stepcC |j|jgSNr!rr"r r r rE zModelWithCRFLoss.metricsc Cst|\}}}|jrt|jdksJntj|dd}|j||dd\}}}|tt|j |j }|j ||j ||t||jdd|j d|j j|j iS Nrr8r9Tr-rloss_valval_r rrr<rr=r6r?r@rArBr!rHrrIrJr) r"r r/r0rKr1r3r5rr r r test_stepIs "zModelWithCRFLoss.test_step)TrF__name__ __module__ __qualname____doc__rrobjectrr+r6rNpropertyrrX __classcell__r r r#r rs   rcs`eZdZdZddeeefffdd Zdd d Zdd d Z d dZ e ddZ ddZ ZS)ModelWithCRFLossDSCLossa Wrapper around the base model for custom training logic. And DSC loss to help improve the performance of NER task. Args: base_model: The model including the CRF layer sparse_target: if the y label is sparse or one-hot, default True metric: the metric for training, default 'accuracy'. Warning: Currently tensorflow metrics like AUC need the output and y_true to be one-hot to cauculate, they are not supported. alpha: parameter for DSC loss Tr333333?rcsnt||_||_||_t|tr%|dkr!tjj j dd|_ nt d|j|_ tjj j dd|_||_dSr)rrrrrrrrrrrrrr r!alpha)r"rrrrdr#r r ras   z ModelWithCRFLossDSCLoss.__init__FcCr%r&r'r(r r r r+pr,zModelWithCRFLossDSCLoss.callc Csn|||d\}}}}t||||d } t|||j} |dur+| |d} | |d} ||t| t| fS)Nr-rr)rrrdrr.) r"r/r0rKr*r1r2r3r4r5ds_lossr r r r6vs  z$ModelWithCRFLossDSCLoss.compute_lossc Cst|\}}}|jrt|jdksJntj|dd}t$}|j|||dd\}}}} || tt |j |j } Wdn1sFwY| | |j } |jt| |j |j| |j||t||jdd|j|jj|jiSr7r;) r"r r/r0rKrLr1r3r5rerrMr r r rNs   z"ModelWithCRFLossDSCLoss.train_stepcCrOrPrQrRr r r rrSzModelWithCRFLossDSCLoss.metricsc Cst|\}}}|jrt|jdksJntj|dd}|j|||dd\}}}}||tt|j |j } |j | |j ||t||jdd|j d|j j|j iSrTrW) r"r r/r0rKr1r3r5rerr r r rXs "z!ModelWithCRFLossDSCLoss.test_step)TrrcrYrZr r r#r rbWs    rb) typingr tensorflowrtensorflow_addons.text.crfr other_lossesrr rModelrrbr r r r s    E