Instructions to use canopylabs/orpheus-3b-0.1-ft with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use canopylabs/orpheus-3b-0.1-ft with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-to-speech", model="canopylabs/orpheus-3b-0.1-ft")# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("canopylabs/orpheus-3b-0.1-ft") model = AutoModelForCausalLM.from_pretrained("canopylabs/orpheus-3b-0.1-ft") - Inference
- Notebooks
- Google Colab
- Kaggle
Tiny and small versions of the model
#21
by stopthinking - opened
any plans to release tiny small models that can be used on device
3b is already pretty small, how small do you need it to be?