Series: The Cost of AI Compute (6 parts)
Who has the GPUs, what that does to the AI map, and what running models really costs: NVIDIA's restrictions and NIMs, Africa's compute gap and monthly AI bills.
NVIDIA's Consumer GPU Restrictions in Data Centers: Impact on Cloud Computing Costs
NVIDIA, a leading manufacturer of graphics processing units (GPUs), has restricted the use of its consumer-grade GPUs, such as the GeForce RTX series, in data center environments through its End-User...
Africa Has the ML Talent But Missing the GPUs.
One challenge I have noticed throughout my academic journey and as a TA is that access to computing resources, especially GPUs, has become a major bottleneck for many students especially...
Geographic Concentration of Machine Learning Models: How Compute Economics Re-Engineered the AI Map
When you look at where notable artificial intelligence models come from, the global map looks empty. In the 2024 Stanford AI Index Report, researchers tracked 149 notable machine learning systems...
Why is Nvidia Selling API Keys Now? The Plain English Guide to NIMs and the AI Cloud
The landscape of artificial intelligence is shifting rapidly. For years, Nvidia was known primarily as a hardware company that manufactured the powerful Graphics Processing Units (GPUs) required for gaming and...
Give Me 8 Minutes To Show What You Can Actually Do With NVIDIA's Model Catalog- The AI Superstore:
If you visit the NVIDIA Build catalog today, you are greeted by a massive list of numbers, acronyms, and technical jargon. You will see names like "Nemotron," "Gemma," and "Mistral."...
Why Your Monthly AI Bill Might Soon Rival Your Headcount Costs From A Personal Experience
The $280 Overnight Surprise A friend pinged me last week, half-laughing, half-panicking 😅 . He'd been running a couple of AI coding agents overnight, just background refactoring and test generation....