j ddlZddlZddlZddlmZddlmZmZmZddl Z ddl Z ddl m Z ddl mZmZmZmZddl mZmZmZddl mZmZd d lmZmZmZmZd Zej:d d d deej<dd d ed ddded dddfde j>dede de fdZ!ed d ddedee"efde de d df d!Z#d)d"ed#ee"d dfd$Z$ d)d%ed&e"d"ed#ee"d df d'Z%d&e"d e"fd(Z&y)*N)Path)AnyDictOptional)msg)SimpleFrozenDict download_file ensure_path get_checksum)get_git_version git_checkoutload_project_config)parse_config_overrides working_dir) PROJECT_FILEArgOptappFassetsT)allow_extra_argsignore_unknown_options)context_settingsz>Path to cloned project. Defaults to current working directory.)helpexists file_okayz--sparsez-SzsUse sparse checkout for assets provided via Git, to only check out and clone the files needed. Requires Git v22.2+.)rz--extraz-ez7Download all assets, including those marked as 'extra'.ctx project_dirsparse_checkoutextracLt|j}t||||y)acFetch project assets like datasets and pretrained weights. Assets are defined in the "assets" section of the project.yml. If a checksum is provided in the project.yml, the file is only downloaded if no local file with the same checksum exists. DOCS: https://github.com/explosion/weasel/tree/main/docs/tutorial/directory-and-assets.md  overridesr r!N)rargsproject_assets)rrr r!r$s [/home/spazio/kingdom_calls/work5/transenv/lib/python3.12/site-packages/weasel/cli/assets.pyproject_assets_clir(s&&'sxx0I' r#r$returnc "t|}t||}|jdgDcgc]}|s|jdts|}}|st j dt ddt jdt|d |D]r}||d z j}|jd } d |vrd } t| |jrb| r*| t|k(rt jd|d z|jrtj |n|j#d|d vs|d dt j$ddd|d vs|d dt j$ddt'|d d|d d||d jd|t jd|D|jd} | st)|| et+|| || uycc}w)aVFetch assets for a project using DVC if possible. project_dir (Path): Path to project directory. sparse_checkout (bool): Use sparse checkout for assets provided via Git, to only check out and clone the files needed. extra (bool): Whether to download all assets, including those marked as 'extra'. )r$rr!zNo assets specified in z< (if assets are marked as extra, download them with --extra)r)exitsz Fetching z asset(s)destchecksumgitzCloning Weasel project templates requires Git and the 'git' command. Make sure it's installed and that the executable is available.)error*Skipping download with matching checksum: repoNz8A git asset must include 'repo', the repository address.rpathzFA git asset must include 'path' - use "" to get the entire repository.branch)r4sparseDownloaded asset url)r rget EXTRA_DEFAULTrwarnrinfolenresolver rr goodis_dirshutilrmtreeunlinkfailrcheck_private_asset fetch_asset) rr$r r! project_pathconfigassetrr-r.git_errr7s r'r&r&0s{+L  CFZZ"-   '=9 F  %l^3o p HHyV Y /0,;eFm+44699Z( E>Q  ' *{{}L,> >HHDU6]OT{{} d+ U5\)U5\&-A-INVWU5\)U5\&-A-I^ e V$e V$U|''1&   HH(/ 0))E"C#D(3  c4 :Y,;s!H r-r.c t|jsd|}tj|y|stjd|y|t |k(rtjd|ytj d|y)aCheck and validate assets without a URL (private assets that the user has to provide themselves) and give feedback about the checksum. dest (Path): Destination path of the asset. checksum (Optional[str]): Optional checksum of the expected file. z?No URL provided for asset. You need to add this file yourself: zAsset already exists: z%Asset exists with matching checksum: z-Asset available but with incorrect checksum: N)rrrr:r>r rC)r-r.errs r'rDrD{sx :   OPTvV   HH-dV4 5 d+ + HHosr3getsizer:removeparentmkdirrconvert_asset_urlr httpx HTTPErrorris_filer@copystrrCr)rFr7r-r. dest_pathes r'rErEs$--/I < 22EdVLMwwy)Q.LTFST )$    " " $t, \ " 8$ 8 #y ) HH(/ 0 8H Y 77 ;L>D6RS8x 8Cy!d3i&7&7&9 CY0.tf56,TF3Q7  8 8 8s1 G+*$EG(BG#G+#G((G++G4ctjd|rId|vrEd|vrA|jdd}tjdd|}t j d||S|S) ztCheck and convert the asset URL if needed. url (str): The asset URL. RETURNS (str): The converted URL. z(http(s?)):\/\/github.comzreleases/downloadz/raw/z github.comzraw.githubusercontent.comz /(tree|blob)//zDownloading from a regular GitHub URL. This will only download the source of the page, not the actual file. Converting the URL to a raw URL.)rematchreplacesubrr:)r7 converteds r'rSrSsj -s3 s * 3 KK .IJ FF+S)<       Jr))N)'rNr]r@pathlibrtypingrrrrTtyperwasabirutilr r r r r rrrrmainrrrrr9commandcwdContextboolr(rXr&rDrErSr)r'rms && MMEE6--   *.$OHDHHJ-mvzGLMz4?tueY3lm      6!1 2! H;H;CH~H; H;  H;  H;VMdMhsmMtM(IM)T)T )T(,)T8@ )T )TX33r)