Shreyan Mohanty

sz14

·

AI & ML interests

Small language models, compression

Recent Activity

updated a model 5 days ago

sz14/cRia-LM-75M-Instruct

updated a model 5 days ago

sz14/cRia-LM-75M

liked a model 6 days ago

View all activity

Organizations

upvoted a paper 9 days ago

Cut Your Losses in Large-Vocabulary Language Models

Paper • 2411.09009 • Published Nov 13, 2024 • 50

upvoted a collection 12 days ago

🦙 cRia 1.0

Clipped Relaxed Iterated Autoregressive Models • 3 items • Updated 12 days ago • 1

upvoted a paper 16 days ago

X-Token: Projection-Guided Cross-Tokenizer Knowledge Distillation

Paper • 2605.21699 • Published May 20 • 3

upvoted a paper 22 days ago

Relaxed Recursive Transformers: Effective Parameter Sharing with Layer-wise LoRA

Paper • 2410.20672 • Published Oct 28, 2024 • 10