AI & ML interests

A programmable Mixture-of-Models router for heterogeneous LLM inference

Organization Card

vLLM Semantic Router — Making Intelligence Work Together