LexiMind / src /models /decoder.py

Commit History

Update LexiMind: improved training, model architecture, and evaluation
1ec7405

OliverPerrin commited on

Fix Pylance type errors, add inductor compilation support
67c3a83

OliverPerrin commited on

Full training run, code cleanup, mypy/ruff fixes
590a604

OliverPerrin commited on

feat: Add FLAN-T5 compatibility with relative position bias
b43ba56

OliverPerrin commited on

Style: Apply ruff formatting
ee1a8a3

OliverPerrin commited on

Refactor: Consolidate dependencies, improve testing, and add CI/CD
d18b34d

OliverPerrin commited on

Updated Greedy Decode w/ a minlen search
a504116

OliverPerrin commited on

Finsihed Decoder Implementation, as well as prediction heads and multitask
1bdd1c1

OliverPerrin commited on

Implemented the following parts for the Transformer model: poisional_encoding, feedfoward, encoder, and skeleton of decoder. As well as Test cases for each class respectively and visualizations
5a20c96

OliverPerrin commited on

Implemented ScaledDotProduct Attention and Multi-Head Attention
204fb3c

OliverPerrin commited on