I also suggest inovelli, they’re solid

I have two 3090 Turbo GPUs and it seems like oobabooga doesn’t split the load between the two cards when I try to run TheBloke/dolphin-2.7-mixtral-8x7b-AWQ.

Does anyone know how to make text generation webui use both cards? Do I need an nvlink between the two cards?

You should probably also sync them. I use orbital sync for this. https://github.com/mattwebbio/orbital-sync