o šº¥gk&ã@sUdZddlZddlZddlZddlZddlmZddlmZddl m Z m Z m Z m Z ddlmZddlmZiZe eefed <dd e ed dfd d „Zdd e ed dfdd„Zdd e ed efdd„Zded e efdd„ZGdd„deƒZede eefd e ejfdd„ƒZdS)u Utility helpers to handle progress bars in `huggingface_hub`. Example: 1. Use `huggingface_hub.utils.tqdm` as you would use `tqdm.tqdm` or `tqdm.auto.tqdm`. 2. To disable progress bars, either use `disable_progress_bars()` helper or set the environment variable `HF_HUB_DISABLE_PROGRESS_BARS` to 1. 3. To re-enable progress bars, use `enable_progress_bars()`. 4. To check whether progress bars are disabled, use `are_progress_bars_disabled()`. NOTE: Environment variable `HF_HUB_DISABLE_PROGRESS_BARS` has the priority. Example: ```py >>> from huggingface_hub.utils import are_progress_bars_disabled, disable_progress_bars, enable_progress_bars, tqdm # Disable progress bars globally >>> disable_progress_bars() # Use as normal `tqdm` >>> for _ in tqdm(range(5)): ... pass # Still not showing progress bars, as `disable=False` is overwritten to `True`. >>> for _ in tqdm(range(5), disable=False): ... pass >>> are_progress_bars_disabled() True # Re-enable progress bars globally >>> enable_progress_bars() # Progress bar will be shown ! >>> for _ in tqdm(range(5)): ... pass 100%|███████████████████████████████████████| 5/5 [00:00<00:00, 117817.53it/s] ``` Group-based control: ```python # Disable progress bars for a specific group >>> disable_progress_bars("peft.foo") # Check state of different groups >>> assert not are_progress_bars_disabled("peft")) >>> assert not are_progress_bars_disabled("peft.something") >>> assert are_progress_bars_disabled("peft.foo")) >>> assert are_progress_bars_disabled("peft.foo.bar")) # Enable progress bars for a subgroup >>> enable_progress_bars("peft.foo.bar") # Check if enabling a subgroup affects the parent group >>> assert are_progress_bars_disabled("peft.foo")) >>> assert not are_progress_bars_disabled("peft.foo.bar")) # No progress bar for `name="peft.foo"` >>> for _ in tqdm(range(5), name="peft.foo"): ... pass # Progress bar will be shown for `name="peft.foo.bar"` >>> for _ in tqdm(range(5), name="peft.foo.bar"): ... pass 100%|███████████████████████████████████████| 5/5 [00:00<00:00, 117817.53it/s] ``` éN)Úcontextmanager)ÚPath)ÚDictÚIteratorÚOptionalÚUnion)Útqdmé)ÚHF_HUB_DISABLE_PROGRESS_BARSÚprogress_bar_statesÚnameÚreturncó`tdur t d¡dSˆdurt ¡dtd<dS‡fdd„tDƒ}|D]}t|=q$dtˆ<dS)a4 Disable progress bars either globally or for a specified group. This function updates the state of progress bars based on a group name. If no group name is provided, all progress bars are disabled. The operation respects the `HF_HUB_DISABLE_PROGRESS_BARS` environment variable's setting. Args: name (`str`, *optional*): The name of the group for which to disable the progress bars. If None, progress bars are disabled globally. Raises: Warning: If the environment variable precludes changes. FzlCannot disable progress bars: environment variable `HF_HUB_DISABLE_PROGRESS_BARS=0` is set and has priority.NÚ_globalcó g|] }| ˆ›d¡r|‘qS©Ú.©Ú startswith©Ú.0Úkey©r ©úQ/var/www/visachat/venv/lib/python3.10/site-packages/huggingface_hub/utils/tqdm.pyÚ †ó z)disable_progress_bars..©r ÚwarningsÚwarnr Úclear©r Úkeys_to_removerrrrÚdisable_progress_barslóÿ  r#cr)a Enable progress bars either globally or for a specified group. This function sets the progress bars to enabled for the specified group or globally if no group is specified. The operation is subject to the `HF_HUB_DISABLE_PROGRESS_BARS` environment setting. Args: name (`str`, *optional*): The name of the group for which to enable the progress bars. If None, progress bars are enabled globally. Raises: Warning: If the environment variable precludes changes. TzkCannot enable progress bars: environment variable `HF_HUB_DISABLE_PROGRESS_BARS=1` is set and has priority.Nrcrrrrrrrr¦rz(enable_progress_bars..rr!rrrÚenable_progress_barsŒr$r%cCsbtdurdS|durt dd¡ S|r*|tvrt| Sd | d¡dd…¡}|st dd¡ S)aæ Check if progress bars are disabled globally or for a specific group. This function returns whether progress bars are disabled for a given group or globally. It checks the `HF_HUB_DISABLE_PROGRESS_BARS` environment variable first, then the programmatic settings. Args: name (`str`, *optional*): The group name to check; if None, checks the global setting. Returns: `bool`: True if progress bars are disabled, False otherwise. TNrréÿÿÿÿ)r r ÚgetÚjoinÚsplitrrrrÚare_progress_bars_disabled¬s ýr*Ú log_levelcCs$|tjkrdSt d¡dkrdSdS)zí Determine if tqdm progress bars should be disabled based on logging level and environment settings. see https://github.com/huggingface/huggingface_hub/pull/2000 and https://github.com/huggingface/huggingface_hub/pull/2698. TÚ TQDM_POSITIONz-1FN)ÚloggingÚNOTSETÚosÚgetenv)r+rrrÚis_tqdm_disabledÉs r1cs6eZdZdZ‡fdd„Zdeddf‡fdd„ Z‡ZS) rz« Class to override `disable` argument in case progress bars are globally disabled. Taken from https://github.com/tqdm/tqdm/issues/619#issuecomment-619639324. cs2| dd¡}t|ƒrd|d<tƒj|i|¤ŽdS)Nr TÚdisable)Úpopr*ÚsuperÚ__init__)ÚselfÚargsÚkwargsr ©Ú __class__rrr5Ýs z tqdm.__init__Úattrr Ncs2z tƒ |¡WdSty|dkr‚YdSw)zBFix for https://github.com/huggingface/huggingface_hub/issues/1603Ú_lockN)r4Ú __delattr__ÚAttributeError)r6r;r9rrr=ãs ÿÿztqdm.__delattr__)Ú__name__Ú __module__Ú __qualname__Ú__doc__r5Ústrr=Ú __classcell__rrr9rrÖs rÚpathc#sšt|tƒr t|ƒ}| d¡4}| ¡j}tdd|d|jd‰|j‰d dt t dt f‡‡fd d „ }||_|Vˆ  ¡Wd ƒd S1sFwYd S) uT Open a file as binary and wrap the `read` method to display a progress bar when it's streamed. First implemented in `transformers` in 2019 but removed when switched to git-lfs. Used in `huggingface_hub` to show progress bar when uploading an LFS file to the Hub. See github.com/huggingface/transformers/pull/2078#discussion_r354739608 for implementation details. Note: currently implementation handles only files stored on disk as it is the most common use case. Could be extended to stream any `BinaryIO` object but we might have to debug some corner cases. Example: ```py >>> with tqdm_stream_file("config.json") as f: >>> requests.put(url, data=f) config.json: 100%|█████████████████████████| 8.19k/8.19k [00:02<00:00, 3.72kB/s] ``` ÚrbÚBTr)ÚunitÚ unit_scaleÚtotalÚinitialÚdescr&Úsizer csˆ|ƒ}ˆ t|ƒ¡|S©N)ÚupdateÚlen)rMÚdata©Úf_readÚpbarrrÚ _inner_readsz%tqdm_stream_file.._inner_readN)r&) Ú isinstancerCrÚopenÚstatÚst_sizerr ÚreadrÚintÚbytesÚclose)rEÚfÚ total_sizerUrrRrÚtqdm_stream_fileìs$€   û "ër`rN)rBÚior-r/rÚ contextlibrÚpathlibrÚtypingrrrrÚ tqdm.autorÚold_tqdmÚ constantsr r rCÚboolÚ__annotations__r#r%r*r[r1ÚBufferedReaderr`rrrrÚs$D        &