Article
Making Knowledge Distillation Cheap Enough to Run at Scale
MultiverseComputingCAI
• • 30
Iker García-Ferrero
Iker
AI & ML interests
NLP, multilingual models, information extraction
Recent Activity
commentedon a paper 6 days ago
Efficient Knowledge Distillation for LLMs: Offline Top-K Logits and a Fused Chunked KL Loss upvoted an article 7 days ago
Making Knowledge Distillation Cheap Enough to Run at Scale submitted a paper 7 days ago
Efficient Knowledge Distillation for LLMs: Offline Top-K Logits and a Fused Chunked KL LossOrganizations
published an article 7 days ago