o NiB@sdZddlmZddlmZddlmZddlZddlZddlmZm Z m Z m Z m Z m Z mZddlmmZddlmZddlmZdZd Zgd Zd d gZGd ddejjZGdddejjZ dS)zMovieLens dataset.)absolute_import)division)print_functionN)AnyCallableDictIteratorListOptionalTuple)movielens_parsinga @article{10.1145/2827872, author = {Harper, F. Maxwell and Konstan, Joseph A.}, title = {The MovieLens Datasets: History and Context}, year = {2015}, issue_date = {January 2016}, publisher = {Association for Computing Machinery}, address = {New York, NY, USA}, volume = {5}, number = {4}, issn = {2160-6455}, url = {https://doi.org/10.1145/2827872}, doi = {10.1145/2827872}, journal = {ACM Trans. Interact. Intell. Syst.}, month = dec, articleno = {19}, numpages = {19}, keywords = {Datasets, recommendations, ratings, MovieLens} } a This dataset contains a set of movie ratings from the MovieLens website, a movie recommendation service. This dataset was collected and maintained by [GroupLens] (https://grouplens.org/), a research group at the University of Minnesota. There are 5 versions included: "25m", "latest-small", "100k", "1m", "20m". In all datasets, the movies data and ratings data are joined on "movieId". The 25m dataset, latest-small dataset, and 20m dataset contain only movie data and rating data. The 1m dataset and 100k dataset contain demographic data in addition to movie and rating data. - "25m": This is the latest stable version of the MovieLens dataset. It is recommended for research purposes. - "latest-small": This is a small subset of the latest version of the MovieLens dataset. It is changed and updated over time by GroupLens. - "100k": This is the oldest version of the MovieLens datasets. It is a small dataset with demographic data. - "1m": This is the largest MovieLens dataset that contains demographic data. - "20m": This is one of the most used MovieLens datasets in academic papers along with the 1m dataset. For each version, users can view either only the movies data by adding the "-movies" suffix (e.g. "25m-movies") or the ratings data joined with the movies data (and users data in the 1m and 100k datasets) by adding the "-ratings" suffix (e.g. "25m-ratings"). The features below are included in all versions with the "-ratings" suffix. - "movie_id": a unique identifier of the rated movie - "movie_title": the title of the rated movie with the release year in parentheses - "movie_genres": a sequence of genres to which the rated movie belongs - "user_id": a unique identifier of the user who made the rating - "user_rating": the score of the rating on a five-star scale - "timestamp": the timestamp of the ratings, represented in seconds since midnight Coordinated Universal Time (UTC) of January 1, 1970 The "100k-ratings" and "1m-ratings" versions in addition include the following demographic features. - "user_gender": gender of the user who made the rating; a true value corresponds to male - "bucketized_user_age": bucketized age values of the user who made the rating, the values and the corresponding ranges are: - 1: "Under 18" - 18: "18-24" - 25: "25-34" - 35: "35-44" - 45: "45-49" - 50: "50-55" - 56: "56+" - "user_occupation_label": the occupation of the user who made the rating represented by an integer-encoded label; labels are preprocessed to be consistent across different versions - "user_occupation_text": the occupation of the user who made the rating in the original string; different versions can have different set of raw text labels - "user_zip_code": the zip code of the user who made the rating In addition, the "100k-ratings" dataset would also have a feature "raw_user_age" which is the exact ages of the users who made the rating Datasets with the "-movies" suffix contain only "movie_id", "movie_title", and "movie_genres" features. )25m latest-small20m100k1mmoviesratingscseZdZdZ    ddeedeedeedeeegeee e ee fffddf fdd Z e defd d Ze defd d Ze defddZe deeegeee e ee ffffddZZS)MovieLensConfigz$BuilderConfig for MovieLens dataset.Nformat_version table_option download_url parsing_fnreturnc sZ|tvr tdt|tvrtdttt|jdi|||_||_||_||_ dS)a/Constructs a MovieLensConfig. Args: format_version: a string to identify the format of the dataset, one of '_FORMAT_VERSIONS'. table_option: a string to identify the table to expose, one of '_TABLE_OPTIONS'. download_url: a string url for downloading the dataset. parsing_fn: a callable for parsing the data. **kwargs: keyword arguments forwarded to super. Raises: ValueError: if format_version is not one of '_FORMAT_VERSIONS' or if table_option is not one of '_TABLE_OPTIONS'. z!format_version must be one of %s.ztable_option must be one of %s.N) _FORMAT_VERSIONS ValueError_TABLE_OPTIONSsuperr__init___format_version _table_option _download_url _parsing_fn)selfrrrrkwargs __class__r\/home/ubuntu/.local/lib/python3.10/site-packages/tensorflow_datasets/structured/movielens.pyr{s   zMovieLensConfig.__init__cC|jSN)r r$rrr(rzMovieLensConfig.format_versioncCr)r*)r!r+rrr(rr,zMovieLensConfig.table_optioncCr)r*)r"r+rrr(rr,zMovieLensConfig.download_urlcCr)r*)r#r+rrr(rszMovieLensConfig.parsing_fn)NNNN)__name__ __module__ __qualname____doc__r strrrr intrrrpropertyrrrr __classcell__rrr&r(rxsB $rc@seZdZdZededddddejded ed ddd dej ded ed ddddejdededddd dej dededddddej dededddd dej dededddddej dededddd dej dededdd dd!ejded"ed#dd d d!ej dg ZejdZd$ejjfd%d&Zd'ejjd$eejjfd(d)Z *d.d+eed$eeeeee fffd,d-Z!d*S)/ MovieLenszMovieLens rating dataset.z 25m-ratingsa This dataset contains 25,000,095 ratings across 62,423 movies, created by 162,541 users between January 09, 1995 and November 21, 2019. This dataset is the latest stable version of the MovieLens dataset, generated on November 21, 2019. Each user has rated at least 20 movies. The ratings are in half-star increments. This dataset does not include demographic data.z0.1.0r rz8http://files.grouplens.org/datasets/movielens/ml-25m.zip)name descriptionversionrrrrz 25m-moviesza This dataset contains data of 62,423 movies rated in the 25m dataset.rzlatest-small-ratingsa This dataset contains 100,836 ratings across 9,742 movies, created by 610 users between March 29, 1996 and September 24, 2018. This dataset is generated on September 26, 2018 and is the a subset of the full latest version of the MovieLens dataset. This dataset is changed and updated over time. Each user has rated at least 20 movies. The ratings are in half-star increments. This dataset does not include demographic data.rzAhttp://files.grouplens.org/datasets/movielens/ml-latest-small.zipzlatest-small-movieszi This dataset contains data of 9,742 movies rated in the latest-small dataset.z 100k-ratingsa This dataset contains 100,000 ratings from 943 users on 1,682 movies. This dataset is the oldest version of the MovieLens dataset. Each user has rated at least 20 movies. Ratings are in whole-star increments. This dataset contains demographic data of users in addition to data on movies and ratings.rz9http://files.grouplens.org/datasets/movielens/ml-100k.zipz 100k-moviesza This dataset contains data of 1,682 movies rated in the 100k dataset.z 1m-ratingsa  This dataset contains 1,000,209 anonymous ratings of approximately 3,900 movies made by 6,040 MovieLens users who joined MovieLens in 2000. This dataset is the largest dataset that includes demographic data. Each user has rated at least 20 movies. Ratings are in whole-star increments. In demographic data, age values are divided into ranges and the lowest age value for each range is used in the data instead of the actual values.rz7http://files.grouplens.org/datasets/movielens/ml-1m.zipz 1m-movieszm This dataset contains data of approximately 3,900 movies rated in the 1m dataset.z 20m-ratingsax This dataset contains 20,000,263 ratings across 27,278 movies, created by 138,493 users between January 09, 1995 and March 31, 2015. This dataset was generated on October 17, 2016. Each user has rated at least 20 movies. Ratings are in half-star increments. This dataset does not contain demographic data.rz8http://files.grouplens.org/datasets/movielens/ml-20m.zipz 20m-moviesz` This dataset contains data of 27,278 movies rated in the 20m datasetrcCstjtjtjtjjgddd}tjtjtjd}tjtjtjjgddtjtjd}i}|j j dkr=| |n=|j j dkrS| || || |n'|j j d krp| || || ||j tjd n | || |tj j|ttj|d d td S)z5Returns DatasetInfo according to self.builder_config.)Action Adventure AnimationChildrenComedyCrime DocumentaryDramaFantasyz Film-NoirHorrorIMAXMusicalMysteryRomancezSci-FiThrillerUnknownWarWesternz(no genres listed))names)movie_id movie_title movie_genres)user_id user_rating timestamp)zacademic/educatorartistzclerical/adminzcustomer servicezdoctor/health care entertainmentzexecutive/managerialfarmer homemakerlawyer librarianzother/not specified programmerretiredzsales/marketing scientistz self-employedstudentztechnician/engineerztradesman/craftsman unemployedwriter) user_genderbucketized_user_ageuser_occupation_labeluser_occupation_text user_zip_coderrr) raw_user_ageNz)https://grouplens.org/datasets/movielens/)builderr7featuressupervised_keyshomepagecitation)tfstringtfdsreSequence ClassLabelfloat32int64boolbuilder_configrupdatercore DatasetInfo _DESCRIPTION FeaturesDict _CITATION)r$movie_features_dictrating_features_dictdemographic_features_dict features_dictrrr(_infofsL              zMovieLens._info dl_managercCs>||jj}tj|d|jj}tjj tj j d|idgS)zReturns SplitGenerators.zml-%sdir_path)r6 gen_kwargs) download_and_extractrqrospathjoinrrkrsSplitGeneratorSplitTRAIN)r$r}extracted_pathr~rrr(_split_generatorss zMovieLens._split_generatorsNr~ccs|j|D]}|VqdS)z>Yields examples by calling the corresponding parsing function.N)rqr)r$r~exrrr(_generate_examplesszMovieLens._generate_examplesr*)"r-r.r/r0rtextwrapdedentr parse_current_ratings_dataparse_current_movies_dataparse_100k_ratings_dataparse_100k_movies_dataparse_1m_ratings_dataparse_1m_movies_dataBUILDER_CONFIGSrkrsVersionVERSIONrtr|downloadDownloadManagerr rrr r1rr r2rrrrrrr(r5s    /?  r5)!r0 __future__rrrrrtypingrrrrr r r tensorflow.compat.v2compatv2ritensorflow_datasets.public_api public_apirktensorflow_datasets.structuredr rwrurrrs BuilderConfigrGeneratorBasedBuilderr5rrrr(s    $  A;