\j)6dZddlZddlmZmZddlZddlmZddlm Z m Z m Z ddl m Z mZddlmZdd lmZmZmZmZmZmZmZmZmZmZdd lmZdd lmZm Z dd l!m"Z"m#Z#e$eeZ%ee Z&ejNd e&Dcic]}||c}e(Z)ee(dze ddjUe%dee%fZ+edZ,e,j[dgddddddeddddddf dee(dzedfdedededee)dze dfd ed!e+d"ee.e d#d$d%fd&ee.e d'd(fd)ee.e d*d+d,fd-ed.ed/dfd0Z/e,j[d1gd2 dQd3ee(ed4fd ed.ed/dfd5Z0e,j[d6d7d8g dRd3ee(ed9fd-ed!e+d.ed/df d:Z1e,j[d;gd< dRd3ee(ed9fd=ee(dze d>d?fd@ee(dze dAfd.ed/df dBZ2e,j[dCdDdEg dSdCee(edFfd.ed/dfdGZ3e,j[dHgdI dTd3ee(ed9fdJee.e dKdLfdMee.e dNdOfd.ed/df dPZ4ycc}w)UzDContains commands to interact with datasets on the Hugging Face Hub.N) Annotatedget_args)execute_raw_sql_query)CLIErrorRepositoryNotFoundErrorRevisionNotFoundError) DatasetSort_TExpandDatasetProperty_T) DatasetCard) REPO_LIST_DEFAULT_LIMIT AuthorOpt FilterOptLimitOpt RevisionOpt SearchOptTokenOpt get_hf_apimake_expand_properties_parser typer_factory)list_repo_files_cmd)ArgumentOption)_dataclass_to_dictoutDatasetSortEnum)typezComma-separated properties to return. When used, only the listed properties (and id) are returned. Example: '--expand=downloads,likes,tags'. Valid: z, .)helpcallbackz"Interact with datasets on the Hub.)rz list | ls)zhf datasets lsz*hf datasets ls --sort downloads --limit 10zhf datasets ls --search "code"z*hf datasets ls --filter benchmark:officialz$hf datasets ls HuggingFaceFW/finewebz'hf datasets ls HuggingFaceFW/fineweb -Rz.hf datasets ls HuggingFaceFW/fineweb --tree -h)examplesFrepo_idzVDataset ID (e.g. `username/repo-name`) to list files from. If omitted, lists datasets.searchauthorfiltersortz Sort results.limitexpandhuman_readablez--human-readablez-hz=Show sizes in human readable format (only for listing files).as_treez--treez3List files in tree format (only for listing files). recursivez --recursivez-Rz0List files recursively (only for listing files).revisiontokenreturnc ||tjd|tjd|tjd|tjd|tk7rtjd|tjdt|d||| | | S|rtjd | rtjd |rtjd | tjd t | } |r |j nd} | j |||| ||Dcgc] }t|}}tj|ycc}w)zList datasets on the Hub, or files in a dataset repo. When called with no argument, lists datasets on the Hub. When called with a dataset ID, lists files in that dataset repo. Nz'Cannot use --search when listing files.z'Cannot use --author when listing files.z'Cannot use --filter when listing files.z%Cannot use --sort when listing files.z&Cannot use --limit when listing files.z'Cannot use --expand when listing files.dataset)r" repo_typer)r*r+r,r-z(Cannot use --tree when listing datasets.z-Cannot use --recursive when listing datasets.z2Cannot use --human-readable when listing datasets.z,Cannot use --revision when listing datasets.r-)r%r$r#r&r'r() click BadParameterr rrvalue list_datasetsrrtable)r"r#r$r%r&r'r(r)r*r+r,r-apisort_key dataset_inforesultss O/root/.hermes/venv/lib/python3.12/site-packages/huggingface_hub/cli/datasets.py datasets_lsr=<s\  $$%NO O  $$%NO O  $$%NO O  $$%LM M + +$$%MN N  $$%NO O")    !KLL  !PQQ  !UVV  !OPP 5 !C!tzztH -- .    <( G IIg s7E! leaderboard)z4hf datasets leaderboard SWE-bench/SWE-bench_VerifiedzLhf datasets leaderboard SWE-bench/SWE-bench_Verified --limit 5 --format jsonzIhf datasets ls --filter benchmark:official # list available leaderboards dataset_idz?The benchmark dataset ID (e.g. `SWE-bench/SWE-bench_Verified`).c0t|}|j|}|d|Dcgc] }t|}}tj|gddtj d|r'tj d|d j d yycc}w) zList model scores from a dataset leaderboard. This command helps find the best models for a task or compare models by benchmark scores. Use 'hf datasets ls --filter benchmark:official' to list available leaderboards.r2)r"N)rankmodel_idr5sourcerBheadersid_keyzPUse 'hf datasets ls --filter benchmark:official' to list available leaderboards.zUse 'hf models info rz' to get details about a model.)rget_dataset_leaderboardrrr7hintrB)r?r'r-r8r>entryr;s r<datasets_leaderboardrJs 5 !C--j-AK6A&56IJU!%(JGJII7 HH _` ' A(?(?'@@_`aKsBinfoz&hf datasets info HuggingFaceFW/finewebz9hf datasets info my-dataset --expand downloads,likes,tagsz+The dataset ID (e.g. `username/repo-name`).ct|} |j|||}t j |y#t$r}td|d|d}~wt$r}td|d|d|d}~wwxYw) z$Get info about a dataset on the Hub.r2)r"r,r(z Dataset 'z ' not found.Nz Revision 'z' not found on 'z'.)rr:rrrrdict)r?r,r(r-r8rKes r< datasets_inforOs 5 !CU XfU HHTN #D:,l;rsK & A[[I0   /(,H%<=>' $))-m/L1/LSVW $J deienenoAeBdCCDE./AB  "FG    -    7O  d no qO  O  O O $O$ & O O O !4.mn pO$ xST V%O, }d)[\ ^-O45O6 7O8 9O Odb#x-noopb b b bb& 0C! #x-Z[[\     " jnTX Q#x-Z[[\ Q cDj&:d"ee f Q S4Z-O!PP Q Q  Q  Q Q   c j  3&ABB C       gl_d g#x-Z[[\gf\8abbcg D&0Z[[ \g  g  ggk0Ms J