Instructions to use DarkArtsForge/Morax-24B-v1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use DarkArtsForge/Morax-24B-v1 with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="DarkArtsForge/Morax-24B-v1")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("DarkArtsForge/Morax-24B-v1")
model = AutoModelForCausalLM.from_pretrained("DarkArtsForge/Morax-24B-v1")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps

vLLM

How to use DarkArtsForge/Morax-24B-v1 with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "DarkArtsForge/Morax-24B-v1"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "DarkArtsForge/Morax-24B-v1",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/DarkArtsForge/Morax-24B-v1

SGLang

How to use DarkArtsForge/Morax-24B-v1 with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "DarkArtsForge/Morax-24B-v1" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "DarkArtsForge/Morax-24B-v1",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "DarkArtsForge/Morax-24B-v1" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "DarkArtsForge/Morax-24B-v1",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use DarkArtsForge/Morax-24B-v1 with Docker Model Runner:
```
docker model run hf.co/DarkArtsForge/Morax-24B-v1
```
Browse Quantizations to use this model in llama.cpp, Ollama, LM Studio, or any compatible app.

⚠️ Warning: This model can produce narratives and RP that contain violent and graphic erotic content. Adjust your system prompt accordingly. Also, use Mistral V7 Tekken template for best results.

Morax 24B v1

This is a creative, intelligent, uncensored, and evil-tuned merge of pre-trained language models created using mergekit.

The result of this merge is quite interesting. Sometimes it chooses to think, and sometimes it doesn't. You can force it to use thinking or nothink if you want though.

This model should have no refusals and therefore not require any ablation or jailbreaks.

Update: Morax has some refusals, but an ablated version is being uploaded.

Merge Details

Merge Method

This model was merged using the SLERP merge method.

Models Merged

The following models were included in the merge:

Naphula/BeaverAI_Fallen-Mistral-Small-3.1-24B-v1e_textonly
TheDrummer/Precog-24B-v1

Configuration

The following YAML configuration was used to produce this model:

base_model: TheDrummer/Precog-24B-v1
architecture: MistralForCausalLM
merge_method: slerp
dtype: float32
out_dtype: bfloat16
slices:
  - sources:
      - model: Naphula/BeaverAI_Fallen-Mistral-Small-3.1-24B-v1e_textonly
        layer_range: [0, 40]
      - model: TheDrummer/Precog-24B-v1
        layer_range: [0, 40]
parameters:
  t: 0.5
tokenizer:
source: union
chat_template: auto
name: Morax-24B-v1

Downloads last month: 26

Safetensors

Model size

24B params

Tensor type

BF16

Model tree for DarkArtsForge/Morax-24B-v1

Naphula/BeaverAI_Fallen-Mistral-Small-3.1-24B-v1e_textonly

TheDrummer/Precog-24B-v1

Merge model

this model

Merges

4 models

Quantizations

10 models