o id)d?d+d@d-dAd2dd9edBed3dCd8dDdEddFgd%dGdHdIddJiddKd!dd"dLd$dMd'dNd)dOd+dPd-dAd2d0d9edBed3dQd5dRd6dSd8dSdEdgdgZdTdUZ dVdWZ dXdYZ dZd[Z d\d]Z iifd^d_Zd`S)aRokfinIEz@https?://(?:www\.)?rokfin\.com/(?P(?Ppost|stream)/\d+)rokfinzHhttps://secure.rokfin.com/auth/realms/rokfin-web/protocol/openid-connectzOhttps://www.rokfin.com/post/57548/Mitt-Romneys-Crazy-Solution-To-Climate-Changez post/57548mp4z.Mitt Romney's Crazy Solution To Climate Changez*re:https://img\.production\.rokfin\.com/.+20211023i taz Jimmy Dore65429z#https://rokfin.com/TheJimmyDoreShowpublicnot_live)idexttitle thumbnail upload_date timestampchannel channel_id channel_url availability live_status dislike_count like_countduration)url info_dictzJhttps://rokfin.com/post/223/Julian-Assange-Arrested-Streaming-In-Real-Timezpost/223z/Julian Assange Arrested: Streaming In Real Time20190412id8\z Ron Placone10zhttps://rokfin.com/RonPlaconezFreeThinkingMedia^zRealProgressives^)rrrrrrr r!r"r#r$r%r&tagszrhttps://www.rokfin.com/stream/10543/Its-A-Crazy-Mess-Regional-Director-Blows-Whistle-On-Pfizers-Vaccine-Trial-Datarz stream/10543rrzR"It's A Crazy Mess" Regional Director Blows Whistle On Pfizer's Vaccine Trial Datar descriptionz$md5:324ce2d3e3b62e659506409e458b9d8er TLAVagabondr!53856r"zhttps://rokfin.com/TLAVagabondr#is_liveFwas_liveTr$riwarelease_timestamp release_date20211102rr%)r&r,zihttps://rokfin.com/post/126703/Brave-New-World--Aldous-Huxley-DEEPDIVE--Chpts-13--Quite-Frankly--Jay-Dyerz post/126703zQBrave New World - Aldous Huxley DEEPDIVE! (Chpts 1-3) - Quite Frankly & Jay DyerzJay Dyer186881zhttps://rokfin.com/jaydyer premium_onlyr&id20230307r,z OpenMind^z$md5:cb04e32e68326c9b2b251b297bacff35r'i zJhttps://rokfin.com/stream/31332/The-Grayzone-live-on-Nordstream-blame-gamez stream/31332z*The Grayzone live on Nordstream blame gamez#re:https://image\.v\.rokfin\.com/.+zMax Blumenthal248902z https://rokfin.com/MaxBlumenthali dgA20230310c Cs~||dd\}}|t||}t|d}|dr#dn |r'dn|dkr-dnd }t|d d td }|d vrNt|j dt|ddtd |dddd}|rUd |igngi}} t |dkrm|j ||d|dkd\}} |st|ddr~|j ddddn|r|j dtj|d|ddt|dd } |pt|d!d"pt|d#} id|d$|d%| d&tt|d&d'd(tt|d)d*tt|d*d+d,tt|d,d-d.t|d/d0t|d1d2tt|d3d4d5tt|d6d7d8| rtd9| ndd:| d;|d kr| ndd|d?|jtt|ddddddd@dA|dBkr;||iSdiS)CNrtype scheduledAt stoppedAtr1 is_upcomingstreamr0rr()content contentUrl expected_type)Nz fake.m3u8z%https?://[^/]+/([^/]+)/storyboard.vtt timelineUrl)r?rCdefaultz#https://stream.v.rokfin.com/%s.m3u8m3u8F)fatallive premiumPlanpremiumz-This video is only available to premium usersTcookies)methodz!Stream is offline; scheduled for z%Y-%m-%d %H:%M:%S)video_idexpected) createdByusername)creatorrP postedAtMilliicreationDateTimeformats subtitlesrr? contentTitler')r?r'r)r? thumbnailUrl1r-)r?contentDescriptionr& likeCountr% dislikeCountr )rOname)rQr\r!)rOr)rQrr"https://rokfin.com/rr2r,)r,.rr$r#) needs_premium is_privateneeds_subscription needs_auth is_unlisted__post_extractorpost)_match_valid_urlgroup!_download_json_using_access_token _API_BASE_URLrgetr rr _search_regexr#_extract_m3u8_formats_and_subtitlesraise_login_requiredraise_no_formatsdtdatetime fromtimestampstrftimerr r _availabilityboolextract_comments) selfr(rM video_typemetadata scheduledr$ video_urlrTrUuploaderrr{K/home/ubuntu/.local/lib/python3.10/site-packages/yt_dlp/extractor/rokfin.py _real_extracts            zRokfinIE._real_extractc csd}tD]}|jtd|ddd|d|d|dt|dddd p+i}|d p2gD]-}t|d t|d |d |ddt|dt|dt|ddVq3t|dpid}|d}|d r|s|r||krdS|durdSqdS)Nzcomment?postId=z&page=&size=50z!Downloading viewer comments page r of %sFnoterGr?commentr\ commentIduserIdrootnumLikes numDislikespostedAt)textauthorr author_idparentr&r%r totalPageslast) itertoolscount_download_jsonrhr rir r r)rurM pages_totalpage_n raw_commentsris_lastr{r{r| _get_commentss8        zRokfinIE._get_commentsc Cs|j|jddddd}t|jd|dd}|j|ddd d t||d d d d}|s?td|p3d r;tdddtd|j |jdddddddddddd}|j |jddd d!tt j t j |jjdd"dd#dd$d%|_dS)&Nzw/auth?client_id=web&redirect_uri=https%3A%2F%2Frokfin.com%2Ffeed&response_mode=fragment&response_type=code&scope=openidzloading login pagezerror loading login page)rerrnotezr]+action\s*=\s*"(https://secure\.rokfin\.com/auth/realms/rokfin-web/login-actions/authenticate\?[^"]+)"zAuthentication URL)r\z logging inFoff)rPpassword rememberMe credentialId)rrGexpected_statusdataz((?i)(invalid\s+username\s+or\s+password)zinvalid username/passwordTrNz Login failedz/authzgranting user authorizationz%user authorization rejected by Rokfinwebnonez(https://rokfin.com/silent-check-sso.htmlfragmentcodeopenid) client_idprompt redirect_uri response_mode response_typescope)rrquery/tokenzgetting access credentialsz error getting access credentialsrauthorization_code)rr grant_typerrrr)_download_webpage _AUTH_BASErrjr_authentication_activeresearchr_request_webpagerurllibparseparse_qs urldefragr(rri_access_mgmt_tokens)rurPr login_pageauthentication_point_url resp_bodyurlhr{r{r|_perform_loginsJ       zRokfinIE._perform_logincCshdt||j S)N>KEYCLOAK_SESSIONKEYCLOAK_IDENTITYKEYCLOAK_SESSION_LEGACYKEYCLOAK_IDENTITY_LEGACY)set _get_cookiesrrur{r{r|rszRokfinIE._authentication_activecCst|jddS)NcSsd|d|dgS)N token_type access_token)join)xr{r{r|sz*RokfinIE._get_auth_token..)r rrr{r{r|_get_auth_tokenszRokfinIE._get_auth_tokenc Csd|vsJ|}|}|jd}|r||d<|j||||dd\}}|r1|jdks1|dur7|||S|j|jd|ddt d|dd d |_||d<|ddur^t d d d |j||||dS)N authorization refresh_tokeni)headersrrrzDUser authorization expired or canceled by Rokfin. Re-authorizing ...zFailed to re-authorizer)rrrrzUser authorization lostTr)rr) copyrrri_download_webpage_handlestatus _parse_jsonrrrr) ruurl_or_requestrMrr auth_tokenr json_stringrr{r{r|rgs0         z*RokfinIE._download_json_using_access_tokenN)__name__ __module__ __qualname__ _VALID_URL_NETRC_MACHINErrint_TESTSr}rrrrrgr{r{r{r|rs8               e9&rc@s$eZdZddddddZddZdS)RokfinPlaylistBaseIErdr>stackvideoaudior> dead_streamrccs|dpgD]7}|j|d}|dkr|dn|d}|r%|s&q|jd|d||d|tt|dd VqdS) Nr? mediaTyperdrmediaIdr]/rV)rM video_title)ri_TYPES url_resultr r )rurwr? media_typerMr{r{r|_get_video_data)s  z$RokfinPlaylistBaseIE._get_video_dataN)rrrrrr{r{r{r|r s rc@s2eZdZdZdZdZddddidgZd d Zd S) RokfinStackIEz rokfin:stackz Rokfin Stacksz2https?://(?:www\.)?rokfin\.com/stack/(?P[^/]+)zShttps://www.rokfin.com/stack/271/Tulsi-Gabbard-Portsmouth-Townhall-FULL--Feb-9-2020r271r(playlist_countr)c Cs.||}|||td|||S)Nzstack/) _match_idplaylist_resultrrrh)rur(list_idr{r{r|r}@s zRokfinStackIE._real_extractN)rrrIE_NAMEIE_DESCrrr}r{r{r{r|r4s rc@s`eZdZdZdZdZdddddd d gZd d d ddddZddZddZ ddZ ddZ dS)RokfinChannelIEzrokfin:channelzRokfin ChannelszXhttps?://(?:www\.)?rokfin\.com/(?!((feed/?)|(discover/?)|(channels/?))$)(?P[^/]+)/?$z https://rokfin.com/TheConvoCouchdz 12071-newzTheConvoCouch - Newz$md5:bb622b1bca100209b91cd685f7847f06)rrr-)r(playlist_mincountr)poststoprrr>r)newrvideospodcastsstreamsstackscCs |dSN)_validate_extractor_argsrr{r{r|_real_initialize]s z RokfinChannelIE._real_initializecCsP|dd}|dur$t|dks|d|jvr&tdd|jdddSdS)Ntabrrz,Invalid extractor-arg "tab". Must be one of z, Tr)_configuration_arglen_TABSrr)rurequested_tabsr{r{r|r`s "z(RokfinChannelIE._validate_extractor_argsc csd}tdD]]}|dvrtd|d|d|d}n td|d|d|}|j||d |d t|dd d }||EdHt|d pMd}|d}|sb|r^||kredS|duredSqdS)Nr)rruser/rz?page=rz post/search/z&size=50&creator=z Downloading video metadata page rr)rrrF)rrrhrr rr ri) rur! channel_namerrrdata_urlrwrr{r{r|_entrieses& zRokfinChannelIE._entriesc Cs~||}|td||}|d}|jddgdd}|||||j||d||d|t| d S) Nr rrrrDr-z - r-) rrrhrrrr rr ri)rur(r  channel_infor!rr{r{r|r}vs (zRokfinChannelIE._real_extractN) rrrrrrrr rrrr}r{r{r{r|rFs,   rc@sfeZdZdZdZdZddddddZdd d d d d gZd Zd Z ddZ ddZ ddZ dddZ d S)RokfinSearchIEz rokfin:searchz Rokfin Search rkfnsearch))rrawrd) content_idrr>)rrrzrkfnsearch5:"zelenko"r~z "zelenko")rrrNcCs4|jj|ddd\|_|_|js|dSdS)NauthNNrD)cacheloadie_key_db_url_db_access_key_get_db_access_credentialsrr{r{r|rs zRokfinSearchIE._real_initializec csd}tdD]V}|j||d|ddd|t|ddd}t|dtd }|d p.gD]&}|jt|d d \}}t||td }|rU|rU|jd |d|dVq/|d s^dSqdS)Nrr)sizecurrent)rpagezDownloading page z of ~%s)rr)metar  total_pagesrAresults) content_typerrr]r)r() rr_run_search_queryr r r rirr) rurr" page_numbersearch_resultsresult video_id_keyrvrMr{r{r|_search_resultss$ zRokfinSearchIE._search_resultscKsht|}tdD]&}|j|j|f||dkd|jid|}|r'|S|d||q dS)Nrrr)rrGrzUpdating access credentials) jsondumpsencoderangerrr write_debugr)rurMrkwargsattemptr'r{r{r|r%s   z RokfinSearchIE._run_search_queryc Csddd}|jd|ddd}td|D]K}|jd||dd d }|td d |d |p3dt|s=qt|dd|_ d|d|_ |j | d|j |j fdStd)N) SEARCH_KEY ENDPOINT_BASEzhttps://rokfin.com/discoverrzDownloading home page)rrz/]*\ssrc\s*=\s*"(/static/js/[^">]+)"zhttps://rokfin.comzDownloading JavaScript fileFrz REACT_APP_(|z)\s*:\s*"([^"]+)"rr3z,/api/as/v1/engines/rokfin-search/search.jsonzBearer r2rz$Unable to extract access credentials)rrfindallupdaterkeysallvaluesrrrrstorerr)rurM auth_datanotfound_err_page js_file_path js_contentr{r{r|rs$  z)RokfinSearchIE._get_db_access_credentialsr)rrrrr _SEARCH_KEYrrrrrr*r%rr{r{r{r|rs, r)rornrr+r urllib.parsercommonrrutilsrrrr r r r r rrrrrhrrrrrr{r{r{r|s8;