A100 GPU prices have fallen 20-30% as sellers liquidate inventory ahead of more efficient Rubin and Blackwell architectures, which offer 3-4x better performance per watt. The aging A100s are increasingly unviable for inference workloads, leaving only price-sensitive enthusiasts and small-scale GPU renters as potential buyers. Market dynamics suggest a continued collapse in value as superior hardware becomes widely financed and available.
Read original
reddit/r/LocalLLaMA