Hyperparams used (found via optuna):
LEARNING_RATE = 4.25e-5 BATCH_SIZE = 16 WEIGHT_DECAY = 0.225 EPOCHS = 4 WARMUP_RATE = 0.1
Files info
Base model