RTX 3090 24GB vs RTX 4070 TI SUPER 16GB (2024)

Which one is the best card for training?

The RTX 4070 TI SUPER is the current generation, it was released only a few months ago as a refresh of the 4070 Ti. It has an extra 4GB of VRAM (up from 12GB) and outperforms the previous generations RTX 3090 in overall gaming benchmarks by around 10%.
Specs: https://www.techpowerup.com/gpu-specs/g ... uper.c4187

The RTX 3090 is the previous generations second best (beaten only by the extremely power hungry 3090 TI.) It has 24GB of VRAM which makes it a very attractive alternative to the uber expensive 4090. The 3090 has more tensor cores, a higher memory bus and significantly higher memory bandwidth than the newer 4070 TI SUPER.
Specs: https://www.techpowerup.com/gpu-specs/g ... 3090.c3622

The 4070 TI SUPER was my first pick because its new, it comes with a warranty, and it uses about 100W less power at load. But now I have the opportunity to buy a 3090 off eBay for a couple of hundred dollars less than the 4070 TI SUPER, which is super tempting because the card looks to be in near new condition and it has that extra 8GB of VRAM.

Hi all,

Let me give my opinion on this question: The most important thing is not the generation of RTX but the quantity of memory!!!
My RTX 4090 goes between 10 to 30% faster than my RTX 3090 depending on the model used (they both have 24GB of memory).
The highest acceleration was obtained with the Dlight model (+48%)

My advice would be to buy the 3090 and increase the batch size to go faster!