Appending my original post. Still waking up.
For this, you need a system that can scale its BAR to meet the Vram needs. Eypc level CPUs are a hard req at this level.
———-
Old post:
A user on the Gamers Nexus Discord had an interesting thought on this. Some claims are already coming true while others I’m not too sure off, like Nvidia destroying GPUs to keep demand high. That said, Nvidia could try and bake a buyback agreement into new contracts going forward that buyers can only sell back working GPUs to Nvidia in exchange for above market value for their used hardware.
DF — 5/16/26, 3:04 AM
Steve Burke
AI is getting more efficient. More efficient AI is driving more demand for AI, but this effect in not always in sync.
Result of a combination of:
-
S oftware side AI inference efficiency gains
-
More GPU designers and fabs entering into the loop
-
next gen hardware gains AI datacenters will find themselves in a situation where post trainning they will be having idling capacity.
And this idling capacity + next gen hardwares entering datacenters is going to create a perfect storm of current gen enterprise gpu’s getting dumped into retailers like Newegg.
GPU shortage of today is not a permamnent shift. It’s a pendulum, and it will swing in the opposite direction hard. A glut of datacenter gpu firesales is coming.
BUT! THAT’S A GOOD THING FOR US.
AND! What’s good for us is bad for Nvidia profit margins.
This scenario of gpu glut is exactly the opposite of what Nvidia wants.
So what does companies do when their margins are pressured by supply? THEY DESTROY THE PERFECTLY USABLE EXISTING SUPPLY JUST SO THAT THEY CAN KEEP SELLING THE NEW SUPPLY AT EXORBITANT PRICES.
This is what luxury brands do? Where does unsold Gucci or whatever clothes go? They go to incinerator. They would rather burn those overpriced clothes than see people accessing them at affordable prices.
So this is exactly what Nvidia and it’s close partners like CoreWeave are going to do.
BUT! GPUs and luxury clothes are fundamentally different. And GPU buyers and overpriced clothing buyers are also ussually fundamentally different.
GPUs are usefull tools and GPU buyers, at least enthusiast part of them are eagerly reading the news and questioning the situation.
So the question is: Is there a.. some sort of “Preserve Useful Tools Act” or something that would prevent Nvidia&Partners from destroying perfectly usable gpus so that they can sell new ones for a higher price?
What’s stopping them from doing this evil act of burning those beauties just so that they preserve the elevated shortage prices for the next gen?
DF — 5/16/26, 3:23 AM
Average enterprise GPU utilization is stuck at 5%
Organizations that panic-procured H100s under 3–5 year depreciation cycles now own depreciating assets that are mostly idle.
5% GPU utilization: The $401 billion AI infrastructure problem enterprises can't keep ignoring | VentureBeat
Per-token inference prices have fallen between 9× and 900× per year for various performance milestones, with Gartner forecasting a further 90% cost reduction by 2030
NVIDIA’s own Groq 3 LPX rack (announced at GTC 2026) combined with the Vera Rubin GPU promises 35× token efficiency improvement and 10× inference cost reduction on-premise
AI Inference Cost Crisis 2026: Why Your AI Bill Is Exploding
On-device inference (Gemini Nano, Apple Intelligence, Microsoft’s Fara-7B) is removing entire classes of queries from the datacenter entirely
https://medium.com/@milesk_33/the-cost-of-scale-why-2026-may-be-the-year-we-shrink-our-models-7af26155271e
Huawei is on track to capture the largest share of China’s AI chip market in 2026, with sales jumping at least 60% amid demand for domestic alternatives
Huawei could seize China’s AI chip crown in 2026 as Nvidia's H200 shipments stall in regulatory limbo — Beijing pushes homegrown AI hardware dominance in a market projected to hit $67 billion by 2030 | Tom's Hardware
GLUT IS COMING:
A100 prices are in gradual decline as organizations upgrade to Hopper/Blackwell. Used A100 80GB units trade at $12,000–$18,000 (down from new pricing), with further depreciation expected as Hopper/Blackwell expand
Buying or Selling GPUs in 2026: Prices, Tips & Rent vs Sell Analysis | GPUnex Blog
The big enterprise gpu firesale glut is coming because AI datacenters will want to become profitable + next gen hardware will arrive + ai inference software will become more efficient + chinese gpu wave will hit full force. These 4 effects will create the situation of pendulum shifting from gpu shortage to gpu glut.
My personal take: I think that we are starting to see signs of the bubble straining.
-
Most Datacenters have been put on hold/canceled.
-
Open weight models are catching up to closed weights very quickly.
-
Open AI/Anthropic going IPO means they ran out of PE/VC money to burn and need IPO in order to get one more injection of cash.
-
Public pushback, especially from younger generations, for “Ai all the things!” is getting more and more vocal and impossible to ignore.
-
Companies are getting burned on token costs, data spills, HIPAA concerns and pulling back on many Ai initiatives to stop cash burns that show little to negative ROI.