Meet the startup helping Wall Street put a price on AI compute
As spending on data centers and GPUs surges, a startup is tackling the lack of a standard way to price AI compute or hedge against price changes.
#gpu
25 articles tagged with “gpu”.
VentureBeat names Rob Strechay as its first Lead Analyst, expanding its enterprise AI research push
VentureBeat has appointed Rob Strechay, formerly of theCUBE Research, as its first Lead Analyst and founding analyst of VentureBeat Research, deepening its enterprise AI coverage.
Nvidia’s new financial strategy does not compute
Nvidia and firms including Apollo, BlackRock, Blackstone, Brookfield, Goldman Sachs, and KKR are assembling $500 billion in financing to frame compute as a new asset class, a claim The Verge scrutinizes.
Same Cluster, 33 Points More Utilization: What Changed Was the Order
A Hugging Face Blog post describes achieving 33 percentage points more utilization on the same cluster by changing the order rather than the hardware.
Securing the Infrastructure of Intelligence
NVIDIA frames AI factories as the defining infrastructure of the AI era, requiring advanced chips, packaging, memory, networking, plus land and power.
Tiered KV cache for large LLMs on Amazon SageMaker HyperPod with Curvine
An AWS blog post details building a tiered KV cache on Amazon SageMaker HyperPod with Curvine, extending the cache into a shared NVMe pool so replicas reuse cache on cost-efficient instances.
NVIDIA AI Factory Compute Is Becoming an Investable Asset Class
NVIDIA announced partnerships with six major financial firms to create independent financing platforms aimed at mobilizing over $500 billion in third-party capital for AI infrastructure buildout.
Why Scaling AI Compute Performance Requires a New Power Architecture
NVIDIA outlines why scaling AI compute requires rethinking power delivery, noting that the challenge lies in how electricity moves from the grid to the GPU, not just total wattage.
Firebird Launches CIS Region’s Largest AI Factory in Armenia
Firebird, an emerging AI cloud, has launched what it describes as the CIS region's largest AI factory in Armenia, using NVIDIA accelerated computing and Dell high-performance infrastructure.
AMD’s datacenter business is booming while gaming takes a backseat
AMD reported that AI-driven demand more than doubled its data center revenue to $5.8 billion, while gaming hardware sales slowed due to price hikes and component shortages.
NVIDIA Joins NSF State and Regional AI Hubs Program to Expand AI Research and Education Across the US
NVIDIA is participating in the NSF's State and Regional AI Infrastructure Hubs program, an initiative to widen access to advanced computing, data, software and expertise for AI-enabled research and education across the US.
GPU Management: Why Idle GPUs Are the New Grounded Aircraft
A Hugging Face Blog post addresses GPU management, framing idle GPUs as a costly problem akin to grounded aircraft.
Samsung’s chip workers are jumping ship to rival SK Hynix
MIT Technology Review reports that engineers at Samsung's semiconductor division are increasingly applying to work for its South Korean rival SK Hynix.
NVIDIA Harnesses Vera CPU to Speed Up Design of Next-Generation CPUs and GPUs
NVIDIA is working with Cadence and Synopsys to optimize electronic design automation applications for its Vera CPU, which it is deploying to accelerate chip design.
At AI Summit, South Korea Outlines Its AI Future With NVIDIA and Partners
South Korea's president and top business and research leaders met with NVIDIA and ecosystem partners at an AI Summit in San Francisco to advance the country's AI development.
AMD takes on Nvidia with its Helios AI rack-scale system
AMD introduced Helios, a rack-scale AI system that the company says will begin shipping to customers later this year, in a challenge to rival Nvidia.
Built in Fort Worth: Wistron Opens Advanced Manufacturing Plant to Produce NVIDIA AI Systems
Wistron opened its first U.S. manufacturing plant in Fort Worth, Texas — a 324,000-square-foot greenfield facility producing superchips used in NVIDIA AI systems.
NVIDIA Vera Rubin Driving Performance Per Watt, Lowest Token Cost for Partners Worldwide
NVIDIA's Vera Rubin is moving into production, with NVL72 racks deployed at major cloud partners and backed by a supply chain spanning over 350 factory sites in 30 countries.
Built for Vera Rubin, NVIDIA Spectrum-6 Arrives in Gigascale AI Factories
NVIDIA has announced Spectrum-6, a networking milestone built for Vera Rubin and aimed at gigascale AI factories connecting hundreds of thousands of GPUs and CPUs.
Bristol Myers Squibb Building Life Science Industry’s Most Advanced AI Factory on NVIDIA Vera Rubin
Bristol Myers Squibb announced it will deploy a second NVIDIA DGX SuperPOD, built on NVIDIA Vera Rubin, to expand one of the largest AI clusters in life sciences.
NVIDIA Vera Rubin Maximizes Intelligence per Dollar for Post-Training Workloads — a Key Metric for Age…
NVIDIA's Vera Rubin is positioned to reduce cost per token for post-training workloads through codesign, maximizing intelligence per dollar for agentic AI.
Why the first GPU financiers are turning to inference chips in a $400 million deal
A $400 million chip-backed loan highlights a move by early GPU financiers toward inference chips as part of the next wave of AI infrastructure financing.
Why Performance per Watt Is the Ultimate Metric for AI Infrastructure Efficiency
NVIDIA frames performance per watt as the defining efficiency metric for AI infrastructure, arguing power is the main constraint on how many tokens an AI factory can generate.
How LLM Inference Works: Tokens, KV Cache, and Why It Costs What It Costs
Every word an LLM generates has a cost in compute, memory, and time. Here is what actually happens during inference — and why it explains latency, throughput, and per-token pricing.
Inside the AI Chip Race: Why Compute Became the Real Bottleneck
Modern AI runs on a scarce resource: specialized compute. This feature unpacks why GPUs became the bottleneck, why everyone is building custom chips, and what it means for the balance of power in AI.