Inference Optimization

inference-optimization's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Articles

nm-research 

published a model 1 day ago

inference-optimization/qwen3.8-27B-speculator.dflash2.updatedparams.epoch1_end

Updated 1 day ago

soyrsoyr 

updated 9 models 2 days ago

inference-optimization/Inkling-0.92B-MTP

Image-Text-to-Text • 0.9B • Updated 2 days ago • 14

inference-optimization/GLM-5-0.88B-MTP-FP8-Dynamic-MFPTQ

Text Generation • 0.9B • Updated 2 days ago • 10

inference-optimization/GLM-5-0.88B-MTP

Text Generation • 0.9B • Updated 2 days ago • 9

inference-optimization/DeepSeek-V3-0.86B-MTP-FP8-Dynamic

Text Generation • 0.9B • Updated 2 days ago • 14

inference-optimization/DeepSeek-V3-0.86B-MTP

Text Generation • 0.9B • Updated 2 days ago • 15

inference-optimization/GLM-4.7-Flash-0.82B-MTP-FP8-Dynamic

Text Generation • 0.8B • Updated 2 days ago • 9

inference-optimization/GLM-4.7-Flash-0.82B-MTP

Text Generation • 0.8B • Updated 2 days ago • 10

inference-optimization/GLM-4.5-Air-0.72B-MTP-FP8-Dynamic

Text Generation • 0.7B • Updated 2 days ago • 10

inference-optimization/GLM-4.5-Air-0.72B-MTP

Text Generation • 0.7B • Updated 2 days ago • 11

soyrsoyr 

updated 2 collections 3 days ago

Tiny Models

Collection

Tiny models used for testing • 33 items • Updated 3 days ago • 3

llm-c mtp test models

Collection

Toy-trained BF16/FP8 fixtures for PR #3225 on Transformers 5.17. Model cards document DSA and Inkling limitations. • 9 items • Updated 3 days ago