Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

microsoft
/
Phi-4-reasoning-plus

Text Generation
Transformers
Safetensors
English
phi3
phi
nlp
math
code
chat
conversational
reasoning
text-generation-inference
Model card Files Files and versions
xet
Community
19

Instructions to use microsoft/Phi-4-reasoning-plus with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

  • Libraries
  • Transformers

    How to use microsoft/Phi-4-reasoning-plus with Transformers:

    # Use a pipeline as a high-level helper
    from transformers import pipeline
    
    pipe = pipeline("text-generation", model="microsoft/Phi-4-reasoning-plus")
    messages = [
        {"role": "user", "content": "Who are you?"},
    ]
    pipe(messages)
    # Load model directly
    from transformers import AutoTokenizer, AutoModelForCausalLM
    
    tokenizer = AutoTokenizer.from_pretrained("microsoft/Phi-4-reasoning-plus")
    model = AutoModelForCausalLM.from_pretrained("microsoft/Phi-4-reasoning-plus")
    messages = [
        {"role": "user", "content": "Who are you?"},
    ]
    inputs = tokenizer.apply_chat_template(
    	messages,
    	add_generation_prompt=True,
    	tokenize=True,
    	return_dict=True,
    	return_tensors="pt",
    ).to(model.device)
    
    outputs = model.generate(**inputs, max_new_tokens=40)
    print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))
  • Notebooks
  • Google Colab
  • Kaggle
  • Local Apps
  • vLLM

    How to use microsoft/Phi-4-reasoning-plus with vLLM:

    Install from pip and serve model
    # Install vLLM from pip:
    pip install vllm
    # Start the vLLM server:
    vllm serve "microsoft/Phi-4-reasoning-plus"
    # Call the server using curl (OpenAI-compatible API):
    curl -X POST "http://localhost:8000/v1/chat/completions" \
    	-H "Content-Type: application/json" \
    	--data '{
    		"model": "microsoft/Phi-4-reasoning-plus",
    		"messages": [
    			{
    				"role": "user",
    				"content": "What is the capital of France?"
    			}
    		]
    	}'
    Use Docker
    docker model run hf.co/microsoft/Phi-4-reasoning-plus
  • SGLang

    How to use microsoft/Phi-4-reasoning-plus with SGLang:

    Install from pip and serve model
    # Install SGLang from pip:
    pip install sglang
    # Start the SGLang server:
    python3 -m sglang.launch_server \
        --model-path "microsoft/Phi-4-reasoning-plus" \
        --host 0.0.0.0 \
        --port 30000
    # Call the server using curl (OpenAI-compatible API):
    curl -X POST "http://localhost:30000/v1/chat/completions" \
    	-H "Content-Type: application/json" \
    	--data '{
    		"model": "microsoft/Phi-4-reasoning-plus",
    		"messages": [
    			{
    				"role": "user",
    				"content": "What is the capital of France?"
    			}
    		]
    	}'
    Use Docker images
    docker run --gpus all \
        --shm-size 32g \
        -p 30000:30000 \
        -v ~/.cache/huggingface:/root/.cache/huggingface \
        --env "HF_TOKEN=<secret>" \
        --ipc=host \
        lmsysorg/sglang:latest \
        python3 -m sglang.launch_server \
            --model-path "microsoft/Phi-4-reasoning-plus" \
            --host 0.0.0.0 \
            --port 30000
    # Call the server using curl (OpenAI-compatible API):
    curl -X POST "http://localhost:30000/v1/chat/completions" \
    	-H "Content-Type: application/json" \
    	--data '{
    		"model": "microsoft/Phi-4-reasoning-plus",
    		"messages": [
    			{
    				"role": "user",
    				"content": "What is the capital of France?"
    			}
    		]
    	}'
  • Docker Model Runner

    How to use microsoft/Phi-4-reasoning-plus with Docker Model Runner:

    docker model run hf.co/microsoft/Phi-4-reasoning-plus
New discussion
Resources
  • PR & discussions documentation
  • Code of Conduct
  • Hub documentation

Abliterated version when???

#16 opened 9 months ago by
Faint6005

Inconsistency on AIME 24 benchmark

#15 opened 9 months ago by
Jung

Thank you microsoft team for this exceptional model!

#14 opened 10 months ago by
Clexi

How do add/append your system prompt into the existing system prompt given my microsoft?

πŸ‘ 1
1
#11 opened about 1 year ago by
shubhamawasthi-0301

"ChatML" & <|im_sep|>

#10 opened about 1 year ago by
darxkies

Running with VLLM is not printing '<think>' tokens.

βž• 7
8
#8 opened about 1 year ago by
TalonOne

Not sure A very Interesting topic, i tried encoding base code in Israeli or Egyptian also programed for DSL line for Dataline transmission?

#7 opened about 1 year ago by
ebearden

Does not support Markdown for code generation

πŸ˜” 2
#6 opened about 1 year ago by
olegshulyakov

Shards taking unusually long time

#4 opened about 1 year ago by
Dheemanthamg

Nicely done with Phi-4-reasoning-plus, and the rest of the family!

#3 opened about 1 year ago by
JohnnieB

Explainer video and collab notebook reasoning prompt testing

#2 opened about 1 year ago by
ritheshSree
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs