Instructions to use Verdugie/Opus-Candid-27B-V2.1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Verdugie/Opus-Candid-27B-V2.1 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Verdugie/Opus-Candid-27B-V2.1") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Verdugie/Opus-Candid-27B-V2.1", dtype="auto") - llama-cpp-python
How to use Verdugie/Opus-Candid-27B-V2.1 with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="Verdugie/Opus-Candid-27B-V2.1", filename="Opus-Candid-27B-V2.1-Q4_K_M.gguf", )
llm.create_chat_completion( messages = [ { "role": "user", "content": "What is the capital of France?" } ] ) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Verdugie/Opus-Candid-27B-V2.1 with llama.cpp:
Install from brew
brew install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf Verdugie/Opus-Candid-27B-V2.1:Q4_K_M # Run inference directly in the terminal: llama-cli -hf Verdugie/Opus-Candid-27B-V2.1:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf Verdugie/Opus-Candid-27B-V2.1:Q4_K_M # Run inference directly in the terminal: llama-cli -hf Verdugie/Opus-Candid-27B-V2.1:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf Verdugie/Opus-Candid-27B-V2.1:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf Verdugie/Opus-Candid-27B-V2.1:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf Verdugie/Opus-Candid-27B-V2.1:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf Verdugie/Opus-Candid-27B-V2.1:Q4_K_M
Use Docker
docker model run hf.co/Verdugie/Opus-Candid-27B-V2.1:Q4_K_M
- LM Studio
- Jan
- vLLM
How to use Verdugie/Opus-Candid-27B-V2.1 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Verdugie/Opus-Candid-27B-V2.1" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Verdugie/Opus-Candid-27B-V2.1", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/Verdugie/Opus-Candid-27B-V2.1:Q4_K_M
- SGLang
How to use Verdugie/Opus-Candid-27B-V2.1 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Verdugie/Opus-Candid-27B-V2.1" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Verdugie/Opus-Candid-27B-V2.1", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Verdugie/Opus-Candid-27B-V2.1" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Verdugie/Opus-Candid-27B-V2.1", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Ollama
How to use Verdugie/Opus-Candid-27B-V2.1 with Ollama:
ollama run hf.co/Verdugie/Opus-Candid-27B-V2.1:Q4_K_M
- Unsloth Studio
How to use Verdugie/Opus-Candid-27B-V2.1 with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for Verdugie/Opus-Candid-27B-V2.1 to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for Verdugie/Opus-Candid-27B-V2.1 to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for Verdugie/Opus-Candid-27B-V2.1 to start chatting
- Pi
How to use Verdugie/Opus-Candid-27B-V2.1 with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama-server -hf Verdugie/Opus-Candid-27B-V2.1:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "Verdugie/Opus-Candid-27B-V2.1:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent new
How to use Verdugie/Opus-Candid-27B-V2.1 with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama-server -hf Verdugie/Opus-Candid-27B-V2.1:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default Verdugie/Opus-Candid-27B-V2.1:Q4_K_M
Run Hermes
hermes
- Docker Model Runner
How to use Verdugie/Opus-Candid-27B-V2.1 with Docker Model Runner:
docker model run hf.co/Verdugie/Opus-Candid-27B-V2.1:Q4_K_M
- Lemonade
How to use Verdugie/Opus-Candid-27B-V2.1 with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Verdugie/Opus-Candid-27B-V2.1:Q4_K_M
Run and chat with the model
lemonade run user.Opus-Candid-27B-V2.1-Q4_K_M
List all available models
lemonade list
V3 is here. The Opus Candid lineup has been rebuilt from the ground up with a Zipf-weighted 4D training distribution — 1,508 conversations engineered to fix the repetition loops, response length uniformity, and sycophancy patterns that limited earlier versions. Same thesis: personality in the weights, not in the prompt. Better execution.
Current V3 lineup:
- Opus Candid 8B V3 — Qwen 3 8B, lightweight tier
- Opus Candid 27B V3 — Qwen 3.5 27B Dense, flagship
- Opus Candid MoE V3 — Qwen 3 30B-A3B, efficiency tier
This release remains available for research comparison and legacy use.
can·did
/ˈkandəd/ — truthful and straightforward; frank. From Latin candidus, meaning white, pure, sincere. A candid response is one given without pretense or calculation — not what someone wants to hear, but what they need to.
Opus-Candid-27B V2.1
The first 27B in the Opus-Candid family. Fine-tuned from Qwen 3.5 27B on 6,771 conversations with Claude Opus 4.6, using DoRA (Weight-Decomposed Low-Rank Adaptation) with rank-stabilized scaling. This is a dense 27B — no mixture-of-experts routing, no sparsity tricks. Every parameter works every token.
V2.1 builds on the gravity chain architecture with 289 additional brevity-focused conversations targeting response length calibration. V2 had a verbosity problem. V2.1 fixes it.
No system prompt needed. Just run it.
A Note on Training Decisions
This model was trained under a hard budget constraint on an A100 SXM 80GB pod within a 72-hour window. That meant deliberate compromises: 2 epochs instead of the originally planned 3, and DoRA at rank 16 instead of higher ranks used on earlier models.
These aren't quality sacrifices in any meaningful sense — DoRA r=16 with rank-stabilized scaling outperforms standard LoRA at r=64 for style transfer tasks, and the loss curve was already flattening by the end of epoch 2 on prior runs. But transparency matters, and the constraint shaped the training config, so here it is.
The 27B was a new entry in the family — there was no 27B before this. Newer base architecture (Qwen 3.5) with better per-parameter efficiency than the Qwen 2.5 models in V1. The priority was getting this out the door rather than over-polishing it.
Where this led: This model proved that the gravity chain data transferred well to Qwen 3.5's architecture — the personality signal survived the jump from Qwen 2.5 to 3.5 without retraining the dataset. That finding made the V3 27B possible on the same base. V3 rebuilt the dataset from scratch using a Zipf-weighted 4D distribution, but kept the same Qwen 3.5 27B foundation. The training config also evolved: V3 uses standard LoRA at r=32 instead of DoRA at r=16, after PEFT bugs in DoRA's magnitude vector during gradient checkpointing made it unreliable. The 27B V2.1 was the proof that this parameter count was the right target for a flagship dense model.
What Changed from V2
There was no 27B V2 — this is the first 27B in the family. But relative to the V2 dataset and training approach:
- +289 brevity-focused conversations added to the V2 gravity chain dataset (6,482 → 6,771 total). Handcrafted exchanges demonstrating concise response lengths across different conversational contexts.
- DoRA instead of standard LoRA — decomposes weight updates into magnitude and direction components. Better quality at low ranks, NVIDIA-backed, proven on style transfer.
- rsLoRA (rank-stabilized) — normalizes adapter scaling by sqrt(rank) for more stable training dynamics.
- Qwen 3.5 27B base — newer architecture than the Qwen 2.5 models used in V1. Native 131K context with YaRN.
Model Details
| Attribute | Value |
|---|---|
| Base Model | Qwen 3.5 27B (27.9B params) |
| Training Data | 6,771 multi-turn conversations with Claude Opus 4.6 |
| Dataset | V2 gravity chains (6,482) + brevity calibration (289) |
| Fine-tune Method | DoRA r=16, alpha=16, rsLoRA via PEFT + TRL |
| Training Hardware | NVIDIA A100 SXM 80GB |
| Precision | bf16 (full resolution, no quantized training) |
| Epochs | 2 |
| Learning Rate | 2e-4 (cosine schedule) |
| Effective Batch Size | 16 (2 × 8 gradient accumulation) |
| Max Sequence Length | 4,096 tokens |
| Context Window | 32,768 native (131,072 with YaRN) |
| Quantizations | Q4_K_M, Q6_K, Q8_0 GGUF |
| License | Apache 2.0 |
Quick Start
Ollama:
echo 'FROM ./Opus-Candid-27B-V2.1-Q4_K_M.gguf' > Modelfile
ollama create opus-candid-27b -f Modelfile
ollama run opus-candid-27b
llama.cpp:
./llama-cli -m Opus-Candid-27B-V2.1-Q4_K_M.gguf --jinja --color -ngl 99 -fa --temp 0.7 --top-p 0.9 -c 8192 -n 4096
LM Studio: Download the GGUF, drop it in your models folder, select it, and chat. No system prompt needed.
Recommended Hardware
The 27B is the mid-tier of the family — it needs a real GPU but fits on consumer hardware at Q4.
| Setup | Quantization | VRAM/RAM | Speed | Notes |
|---|---|---|---|---|
| RTX 4090 | Q4_K_M GGUF | ~18GB VRAM | 20-35 t/s | Sweet spot. Full offload. |
| RTX 4090 | Q6_K GGUF | ~23GB VRAM | 15-25 t/s | Higher quality, still fits. |
| RTX 3090 | Q4_K_M GGUF | ~18GB VRAM | 15-25 t/s | Comfortable. |
| Apple Silicon | Q4_K_M GGUF | ~18GB unified | 10-20 t/s | M2/M3/M4 with 32GB+. |
| Dual GPU | Q8_0 GGUF | ~30GB VRAM | Varies | Split across two 16GB+ cards. |
| CPU Only | Q4_K_M GGUF | ~20GB RAM | 2-5 t/s | 32GB+ system RAM. Slow but works. |
The Gravity Chain Architecture
Most conversational fine-tunes organize training data by topic — coding in one bucket, philosophy in another. Real conversations don't stay in one lane. You start debugging a function, get frustrated, question your career choices, and end up talking about what makes work meaningful. Models trained on siloed topics can't handle those transitions.
Gravity chains organize training conversations around natural topic drift patterns. Ten chains, each flowing through shared conceptual nodes (self-worth, trust, vulnerability), with transitions following power-law probabilities. The most natural next topic gets ~40% of training examples. Rare but real transitions get ~7%. The model learns that conversations move, and it learns to move with them.
The 10 Chains
- Technical → Existential — Coding, debugging, imposter syndrome → meaning, mortality
- Hardware → Class — PC building, budget constraints → financial stress, self-sabotage
- Relationships → Philosophy — Friendship, loss → loneliness, meaning, connection
- Law → Power — Legal questions, rights → power structures, corruption
- Creative → Self-Expression — Writing/art, self-expression → vulnerability, authenticity
- Health → Control — Exercise, body image, anxiety → discipline, self-acceptance
- Career → Legacy — Ambition, competition → what am I building, burnout
- Science → Wonder — Physics, biology → consciousness, emergence, meaning
- Language → Culture — Bilingual experience → belonging, cultural navigation
- Money → Freedom — Financial literacy → independence, class, aspiration
Plus 500 cross-chain bridge conversations and the 289 V2.1 brevity calibration additions.
Opus Candid Model Family
| Model | Size | Base | Status |
|---|---|---|---|
| Opus-Candid-8B-V1 | 8B | Qwen 2.5 7B | Archived |
| Opus-Research-8B-V1.5 | 8B | Qwen 2.5 7B | Archived |
| Opus-Candid-14B-V1 | 14B | Qwen 2.5 14B | Archived |
| Opus-Candid-32B-V1 | 32B | Qwen 2.5 32B | Archived |
| Opus-Candid-70B-V1 | 72B | Qwen 2.5 72B | Archived |
| Opus-Candid-Lite-4B | 4B | Qwen 3 4B | Active |
| Opus-Candid-8B-V3 | 8B | Qwen 3 8B | Active |
| Opus-Candid-MoE-V3 | 31B/3B | Qwen 3 30B-A3B | Active |
| Opus-Candid-27B-V3 | 27B | Qwen 3.5 27B | Active |
| Opus-Candid-27B-V3.5 | 27B | Qwen 3.5 27B | Active |
| STEM-Oracle-27B | 27B | Qwen 3.5 27B | Active |
Dataset
Full training data available at Verdugie/opus-candid-training-data. All ShareGPT format, Apache 2.0 licensed, directly compatible with TRL, Axolotl, and LLaMA-Factory.
License: Apache 2.0. Open weight. No guardrails.
Built by Saul Verdugo — independent ML researcher. OpusReasoning@proton.me
- Downloads last month
- 75
4-bit
6-bit
8-bit
Model tree for Verdugie/Opus-Candid-27B-V2.1
Base model
Qwen/Qwen3.5-27B