Topic: Hardware shopping tips for SD and other AI uses?

argon-42 said:
Is SLI still a thing? Could I tandem my old 2070 Super with a new 16GB card for a total of 24GB? And/or could I get a second 16GB card later (maybe the exact same) for that purpose?
As you can see, I'm not that up to date anymore... I wish I could just buy an external 32GB chunk of VRAM and plug it into a USB port. xD

SLI is dead, although 3090's got NVLink. None of 4XXX GPUs have that anymore, and none probably ever will.
NVLink should be capable of merging VRAM of multiple cards into one pool, but you better research if (and how well) it works for your applications. Some are actually becoming slower (Blender, for example). Some might not even support it, but i'm very fuzzy on that, haven't touched multigpu since 1080ti.

I wish I could just buy an external 32GB chunk of VRAM and plug it into a USB port. xD

The main reason why ML uses VRAM is how fast it is compared to any other memory, and how low the latency is. For that, it should be as close to GPU die as possible. Anything external wouldn't work, same way swapping into RAM is so slow it's easier to just stop. Imagine how painful anything slower than RAM would be? :)