What is the best ML GPU card for 10k or under?
Conversation
Replying to
What application? In some usage, there's an argument to be made for a few lower spec cards over One Big Boi
1
1
Replying to
Application will be widely variable use. I'm looking to get something that has decent performance across the spectrum of ML use cases.
1
Replying to
For general purpose, I've been pleased with the RTX 3060. Works well with tensorflow. Had to fight to get pytorch to work, but it works. Darknet was painless to get working with CUDA 10. What it lacks in speed it makes up with memory (12G). Usually sub $1K.
1
Show replies
Replying to
If your question is "how can I train the most/largest models the fastest for under 10k", cloud services are the answer. An A100 costs ~10K, but you can rent them from (say) Google for under $3 / hour. Only worth buying if you have very consistent workload.
1
If you really want something fancy on your desktop, wait for a 4090...