Download tokenizer.py from ziadrone/shivik-m1-v3-4: direct link, hf CLI and curl.
- Browser
- Download file 87 Bytes
-
https://huggingface.co/ziadrone/shivik-m1-v3-4/resolve/main/tokenizer.py
- Command line
-
hf download hf://ziadrone/shivik-m1-v3-4/tokenizer.py
-
curl -L -o tokenizer.py https://huggingface.co/ziadrone/shivik-m1-v3-4/resolve/main/tokenizer.py
87 Bytes
| from .tokenization_shivik_m1 import ShivikM1Tokenizer | |
| __all__ = ["ShivikM1Tokenizer"] | |