Instructions to use beomi/KoAlpaca-RealQA-Solar-Ko-Recovery-11B-LoRA-ChatML with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use beomi/KoAlpaca-RealQA-Solar-Ko-Recovery-11B-LoRA-ChatML with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("beomi/KoAlpaca-RealQA-Solar-Ko-Recovery-11B-LoRA-ChatML", dtype="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Unsloth Studio
How to use beomi/KoAlpaca-RealQA-Solar-Ko-Recovery-11B-LoRA-ChatML with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for beomi/KoAlpaca-RealQA-Solar-Ko-Recovery-11B-LoRA-ChatML to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for beomi/KoAlpaca-RealQA-Solar-Ko-Recovery-11B-LoRA-ChatML to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for beomi/KoAlpaca-RealQA-Solar-Ko-Recovery-11B-LoRA-ChatML to start chatting
Load model with FastModel
pip install unsloth from unsloth import FastModel model, tokenizer = FastModel.from_pretrained( model_name="beomi/KoAlpaca-RealQA-Solar-Ko-Recovery-11B-LoRA-ChatML", max_seq_length=2048, )
모델 질문
#1
by Austin9 - opened
이모델은 전 모델과 무엇이 다른가요? chatML이 뭘 의미하죠?
감사합니다.
@Austin9 이전에는 Alpaca Format (### Instruction: ~~ ## Answer: ~~) 포맷이고 이건 ChatML 템플릿을 사용해 학습한 것입니다 :) 모델 성능은 동일하게 보셔도 됩니다. Chat Template만 달라요.
- ChatML 템플릿은 아래같은 형태입니다.
<|system|>
You are a helpful and knowledgeable assistant.
<|user|>
How does the solar system work?
<|assistant|>
The solar system is a gravitationally bound system consisting of the Sun and the objects that orbit it, including planets, moons, asteroids, comets, and more. The Sun's gravity keeps these objects in their orbits.
beomi changed discussion status to closed