How to use google/gemma-4-E4B-it-assistant with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("google/gemma-4-E4B-it-assistant") model = AutoModelForCausalLM.from_pretrained("google/gemma-4-E4B-it-assistant", device_map="auto")
Please explain.
· Sign up or log in to comment
