XiaomiMiMo/MiMo-V2.5-Pro | INT4 (W4A16)
#47
by INC4AI - opened
Pipeline Failure Report
Model: XiaomiMiMo/MiMo-V2.5-Pro
Quantization Scheme: INT4 (W4A16)
Failed Phase: quantize
Run ID: MiMo-V2.5-Pro-AutoRound-W4A16-RTN
Error Category: infrastructure_disk_space
Full Error Log
12:08:05 [INFO] HTTP Request: HEAD https://huggingface.co/XiaomiMiMo/MiMo-V2.5-Pro/resolve/main/merges.txt "HTTP/1.1 307 Temporary Redirect"
12:08:05 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/XiaomiMiMo/MiMo-V2.5-Pro/21d1ecfecd7bd70f31be25ca49d7edd21f003659/merges.txt "HTTP/1.1 200 OK"
12:08:05 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/XiaomiMiMo/MiMo-V2.5-Pro/21d1ecfecd7bd70f31be25ca49d7edd21f003659/merges.txt "HTTP/1.1 200 OK"
12:08:05 [INFO] HTTP Request: HEAD https://huggingface.co/XiaomiMiMo/MiMo-V2.5-Pro/resolve/main/tokenizer.json "HTTP/1.1 302 Found"
12:08:06 [INFO] HTTP Request: HEAD https://huggingface.co/XiaomiMiMo/MiMo-V2.5-Pro/resolve/main/added_tokens.json "HTTP/1.1 307 Temporary Redirect"
12:08:06 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/XiaomiMiMo/MiMo-V2.5-Pro/21d1ecfecd7bd70f31be25ca49d7edd21f003659/added_tokens.json "HTTP/1.1 200 OK"
12:08:06 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/XiaomiMiMo/MiMo-V2.5-Pro/21d1ecfecd7bd70f31be25ca49d7edd21f003659/added_tokens.json "HTTP/1.1 200 OK"
12:08:06 [INFO] HTTP Request: HEAD https://huggingface.co/XiaomiMiMo/MiMo-V2.5-Pro/resolve/main/special_tokens_map.json "HTTP/1.1 307 Temporary Redirect"
12:08:07 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/XiaomiMiMo/MiMo-V2.5-Pro/21d1ecfecd7bd70f31be25ca49d7edd21f003659/special_tokens_map.json "HTTP/1.1 200 OK"
12:08:07 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/XiaomiMiMo/MiMo-V2.5-Pro/21d1ecfecd7bd70f31be25ca49d7edd21f003659/special_tokens_map.json "HTTP/1.1 200 OK"
12:08:07 [INFO] HTTP Request: HEAD https://huggingface.co/XiaomiMiMo/MiMo-V2.5-Pro/resolve/main/chat_template.jinja "HTTP/1.1 404 Not Found"
12:08:08 [INFO] HTTP Request: GET https://huggingface.co/api/models/XiaomiMiMo/MiMo-V2.5-Pro "HTTP/1.1 200 OK"
12:08:08 [INFO] Loading model...
12:08:08 [INFO] HTTP Request: HEAD https://huggingface.co/XiaomiMiMo/MiMo-V2.5-Pro/resolve/main/config.json "HTTP/1.1 307 Temporary Redirect"
12:08:08 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/XiaomiMiMo/MiMo-V2.5-Pro/21d1ecfecd7bd70f31be25ca49d7edd21f003659/config.json "HTTP/1.1 200 OK"
12:08:08 [INFO] HTTP Request: HEAD https://huggingface.co/XiaomiMiMo/MiMo-V2.5-Pro/resolve/main/configuration_mimo_v2.py "HTTP/1.1 307 Temporary Redirect"
12:08:08 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/XiaomiMiMo/MiMo-V2.5-Pro/21d1ecfecd7bd70f31be25ca49d7edd21f003659/configuration_mimo_v2.py "HTTP/1.1 200 OK"
12:08:08 [INFO] HTTP Request: HEAD https://huggingface.co/XiaomiMiMo/MiMo-V2.5-Pro/resolve/main/modeling_mimo_v2.py "HTTP/1.1 307 Temporary Redirect"
12:08:08 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/XiaomiMiMo/MiMo-V2.5-Pro/21d1ecfecd7bd70f31be25ca49d7edd21f003659/modeling_mimo_v2.py "HTTP/1.1 200 OK"
12:08:08 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/XiaomiMiMo/MiMo-V2.5-Pro/21d1ecfecd7bd70f31be25ca49d7edd21f003659/modeling_mimo_v2.py "HTTP/1.1 200 OK"
[transformers] A new version of the following files was downloaded from https://huggingface.co/XiaomiMiMo/MiMo-V2.5-Pro:
- modeling_mimo_v2.py
. Make sure to double-check they do not contain any added malicious code. To avoid downloading new versions of the code file, you can pin a revision.
12:08:09 [INFO] HTTP Request: HEAD https://huggingface.co/XiaomiMiMo/MiMo-V2.5-Pro/resolve/main/model.safetensors "HTTP/1.1 404 Not Found"
12:08:09 [INFO] HTTP Request: HEAD https://huggingface.co/XiaomiMiMo/MiMo-V2.5-Pro/resolve/main/model.safetensors.index.json "HTTP/1.1 302 Found"
12:08:10 [INFO] HTTP Request: GET https://huggingface.co/api/models/XiaomiMiMo/MiMo-V2.5-Pro/revision/main "HTTP/1.1 200 OK"
12:08:10 [INFO] HTTP Request: GET https://huggingface.co/api/models/XiaomiMiMo/MiMo-V2.5-Pro/tree/21d1ecfecd7bd70f31be25ca49d7edd21f003659?recursive=true&expand=false "HTTP/1.1 200 OK"
/root/.venv/lib/python3.12/site-packages/huggingface_hub/file_download.py:746: UserWarning: Not enough free disk space to download the file. The expected file size is: 31264.22 MB. The target location /root/.cache/huggingface/hub/models--XiaomiMiMo--MiMo-V2.5-Pro/blobs only has 25030.56 MB free disk space.
warnings.warn(
12:16:52 [ERROR] Quantization failed: Task error: File reconstruction error: IO Error: No space left on device (os error 28)
Traceback (most recent call last):
File "/root/_work/1/s/auto_quant/phases/quantize.py", line 479, in <module>
quantize(args)
File "/root/_work/1/s/auto_quant/phases/quantize.py", line 293, in quantize
model = AutoModelForCausalLM.from_pretrained(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/.venv/lib/python3.12/site-packages/auto_round/utils/common.py", line 140, in patched
return underlying_func(klass, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/.venv/lib/python3.12/site-packages/transformers/models/auto/auto_factory.py", line 385, in from_pretrained
return model_class.from_pretrained(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/.venv/lib/python3.12/site-packages/transformers/modeling_utils.py", line 4355, in from_pretrained
checkpoint_files, sharded_metadata = _get_resolved_checkpoint_files(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/.venv/lib/python3.12/site-packages/transformers/modeling_utils.py", line 814, in _get_resolved_checkpoint_files
checkpoint_files, sharded_metadata = get_checkpoint_shard_files(
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/.venv/lib/python3.12/site-packages/transformers/utils/hub.py", line 894, in get_checkpoint_shard_files
cached_filenames = cached_files(
^^^^^^^^^^^^^
File "/root/.venv/lib/python3.12/site-packages/transformers/utils/hub.py", line 527, in cached_files
raise e
File "/root/.venv/lib/python3.12/site-packages/transformers/utils/hub.py", line 452, in cached_files
snapshot_download(
File "/root/.venv/lib/python3.12/site-packages/huggingface_hub/utils/_validators.py", line 88, in _inner_fn
return fn(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^
File "/root/.venv/lib/python3.12/site-packages/huggingface_hub/_snapshot_download.py", line 522, in snapshot_download
hf_thread_map(
File "/root/.venv/lib/python3.12/site-packages/huggingface_hub/utils/tqdm.py", line 441, in hf_thread_map
results[future_to_index[future]] = future.result()
^^^^^^^^^^^^^^^
File "/root/.local/share/uv/python/cpython-3.12.13-linux-x86_64-gnu/lib/python3.12/concurrent/futures/_base.py", line 449, in result
return self.__get_result()
^^^^^^^^^^^^^^^^^^^
File "/root/.local/share/uv/python/cpython-3.12.13-linux-x86_64-gnu/lib/python3.12/concurrent/futures/_base.py", line 401, in __get_result
raise self._exception
File "/root/.local/share/uv/python/cpython-3.12.13-linux-x86_64-gnu/lib/python3.12/concurrent/futures/thread.py", line 59, in run
result = self.fn(*self.args, **self.kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/.venv/lib/python3.12/site-packages/huggingface_hub/_snapshot_download.py", line 502, in _inner_hf_hub_download
hf_hub_download( # type: ignore
File "/root/.venv/lib/python3.12/site-packages/huggingface_hub/utils/_validators.py", line 88, in _inner_fn
return fn(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^
File "/root/.venv/lib/python3.12/site-packages/huggingface_hub/file_download.py", line 1019, in hf_hub_download
return _hf_hub_download_to_cache_dir(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/.venv/lib/python3.12/site-packages/huggingface_hub/file_download.py", line 1242, in _hf_hub_download_to_cache_dir
_download_to_tmp_and_move(
File "/root/.venv/lib/python3.12/site-packages/huggingface_hub/file_download.py", line 1932, in _download_to_tmp_and_move
xet_get(
File "/root/.venv/lib/python3.12/site-packages/huggingface_hub/file_download.py", line 565, in xet_get
with session.new_file_download_group(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
RuntimeError: Task error: File reconstruction error: IO Error: No space left on device (os error 28)
Auto-generated by error_analysis pipeline. cc @lvkaokao