furiosa-ai/EXAONE-4.0-32B-FP8

Model Overview

• Model Architecture: Exaone4
  • Input: Text
  • Output: Text
• Model Optimizations:
• Maximum Context Length: 131072 tokens
• Intended Use Cases: Same as EXAONE-4.0-32B-FP8, this model is intended for assistant-like chat.
• Release Date: 01/23/2026
• Version: v2026.1
• License(s): EXAONE AI Model License Agreement 1.2 - NC
• Supported Inference Engine(s): Furiosa LLM
• Supported Hardware Compatibility: FuriosaAI RNGD
• Preferred Operating System(s): Linux
• Quantization: FP8 (Weight: float8, Activation: float8)

Description:

This model is the pre-compiled version of the EXAONE-4.0-32B-FP8, which is an auto-regressive language model that uses an optimized transformer architecture.

Usage

To run this model with Furiosa-LLM, follow the example command below after installing Furiosa-LLM and its prerequisites.

furiosa-llm serve furiosa-ai/EXAONE-4.0-32B-FP8