o 0i7@sddlZddlZddlmZddlmZddlmZddlm Z m Z m Z m Z m Z mZmZddlmZddlmZGd d d eZGd d d eZGd ddeZdS)N) defaultdict) HTMLParser)Path)AnyCallableDictListOptionalTupleUnion)Image) VisionDatasetcs|eZdZdZdeeefddffdd Zdedee ee efddfd d Z deddfd d Z d eddfddZ ZS)Flickr8kParserzBParser for extracting captions from the Flickr8k dataset web page.rootreturnNcs,t||_i|_d|_d|_d|_dS)NF)super__init__r annotationsin_table current_tag current_img)selfr __class__Y/home/ubuntu/SoloSpeech/.venv/lib/python3.10/site-packages/torchvision/datasets/flickr.pyrs  zFlickr8kParser.__init__tagattrscCs||_|dkr d|_dSdS)NtableTrr)rrrrrrhandle_starttag zFlickr8kParser.handle_starttagcCsd|_|dkr d|_dSdS)NrFr )rrrrr handle_endtag#r"zFlickr8kParser.handle_endtagdatacCs|jrJ|dkr d|_dS|jdkr3|dd}tj|j|d}t|d}||_g|j |<dS|jdkrL|jrN|j}|j | | dSdSdSdS)NzImage Not Founda/z_*.jpgrli) rrrsplitospathjoinrglobrappendstrip)rr$img_idrrr handle_data)s   zFlickr8kParser.handle_data)__name__ __module__ __qualname____doc__r strrrrr r r!r#r1 __classcell__rrrrr s & rc steZdZdZ  ddeeefdedeedeeddf fdd Z d e de e e ffd d Z de fd dZZS)Flickr8ka`Flickr8k Entities `_ Dataset. Args: root (str or ``pathlib.Path``): Root directory where images are downloaded to. ann_file (string): Path to annotation file. transform (callable, optional): A function/transform that takes in a PIL image and returns a transformed version. E.g, ``transforms.PILToTensor`` target_transform (callable, optional): A function/transform that takes in the target and transforms it. Nrann_file transformtarget_transformrcstj|||dtj||_t|j}t|j}| | Wdn1s,wY|j |_ t t |j |_dS)Nr:r;)rrr*r+ expanduserr9rropenfeedreadrlistsortedkeysids)rrr9r:r;parserfhrrrrDs  zFlickr8k.__init__indexcCsT|j|}t|d}|jdur||}|j|}|jdur&||}||fSz Args: index (int): Index Returns: tuple: Tuple (image, target). target is a list of captions for the image. RGBN)rDr r>convertr:rr;)rrGr0imgtargetrrr __getitem__Vs      zFlickr8k.__getitem__cC t|jSNlenrDrrrr__len__l zFlickr8k.__len__NN)r2r3r4r5r r6rr rrintr rrMrSr7rrrrr88s" r8c sleZdZdZ  ddededeedeeddf fdd Zd ede e e ffd d Z defd dZ Z S) Flickr30ka `Flickr30k Entities `_ Dataset. Args: root (str or ``pathlib.Path``): Root directory where images are downloaded to. ann_file (string): Path to annotation file. transform (callable, optional): A function/transform that takes in a PIL image and returns a transformed version. E.g, ``transforms.PILToTensor`` target_transform (callable, optional): A function/transform that takes in the target and transforms it. Nrr9r:r;rc stj|||dtj||_tt|_t |j"}|D]}| d\}}|j|dd |qWdn1s?wYtt |j|_dS)Nr< r')rrr*r+r=r9rrArr>r/r)r.rBrCrD) rrr9r:r;rFliner0captionrrrr|s  zFlickr30k.__init__rGcCsd|j|}tj|j|}t|d}|jdur||}|j |}|j dur.| |}||fSrH) rDr*r+r,rr r>rJr:rr;)rrGr0filenamerKrLrrrrMs      zFlickr30k.__getitem__cCrNrOrPrRrrrrSrTzFlickr30k.__len__rU)r2r3r4r5r6r rrrVr rrMrSr7rrrrrWps"rW)r-r* collectionsr html.parserrpathlibrtypingrrrrr r r PILr visionrrr8rWrrrrs   $  +8