Getting out of memory OOM on 8x40GB setup, any solution?
#19
by apoorvumang - opened
I'm trying the multi gpu command on an 8x40GB setup and getting OOM. Is there a recommended way to fix this? Thanks!
I'm having issues with 4x 3090s. The chart from the model card indicates this should use about 41 GB, but it quickly fills every card and errors OOM.