Update LexiMind: improved training, model architecture, and evaluation 1ec7405 OliverPerrin commited on 17 days ago
Fix Pylance type errors, add inductor compilation support 67c3a83 OliverPerrin commited on 19 days ago
feat: Add FLAN-T5 compatibility with relative position bias b43ba56 OliverPerrin commited on 21 days ago
Refactor: Consolidate dependencies, improve testing, and add CI/CD d18b34d OliverPerrin commited on 22 days ago
Finsihed Decoder Implementation, as well as prediction heads and multitask 1bdd1c1 OliverPerrin commited on Oct 29
Implemented the following parts for the Transformer model: poisional_encoding, feedfoward, encoder, and skeleton of decoder. As well as Test cases for each class respectively and visualizations 5a20c96 OliverPerrin commited on Oct 29
Implemented ScaledDotProduct Attention and Multi-Head Attention 204fb3c OliverPerrin commited on Oct 27