Skip to content

Topic

Inference Accelerators and Compute Supply

Topic covering AI inference hardware beyond standard GPUs, such as wafer-scale chips, decode accelerators and inference cards, plus compute supply deals.

Current stories

buildConfirmed5 publishers

Intel puts 1.3 PFLOPS of FP8 and 480GB of LPDDR5X on a 350W air-cooled card

Intel named Crescent Island the GPU D-Series at OCP 2026, a 350W air-cooled PCIe card with up to 480GB of LPDDR5X. Tom's Hardware reported a 1.3 PFLOPS FP8 peak target and 1.5 TB/s of bandwidth; customer sampling is in progress.

Publishers:phoronix.com qz.com servethehome.com storagereview.com tomshardware.com

Perspective Coverage

5 publishers
Builder
Builder 36%
Operator
Operator 33%
Investor
Investor 31%

Reality

Evidence40
Adoption12
Hype gap+20
Incentives65
Confidence72
buildOne report1 publisher

IBM wires its Spyre inference card into PyTorch as a native device

IBM's torch-spyre team made the Spyre inference accelerator a native PyTorch device on PrivateUse1, the allocator, streams and Inductor. Teams on IBM Z, LinuxONE and Power can reach the card from ordinary eager and compiled PyTorch code through one launch path.

Publishers:pytorch.org

Reality

Evidence45
Adoption
Not scored
Hype gap+15
Incentives65
Confidence50
buildConfirmed2 publishers

NVIDIA ships Groq 3 LPX and starts quoting inference in tokens per user, not per rack

The accelerator is in full production and the headline number is a single-request generation rate at 100,000 tokens of context. That is a different purchase order than throughput.

Perspective Coverage

3 publishers
Builder
Builder 48%
Operator
Operator 25%
Investor
Investor 27%

Reality

Evidence55
Adoption20
Hype gap+35
Incentives80
Confidence60
buildConfirmed9 publishers

OpenAI's first Jalapeno numbers buy it leverage, not a procurement input

The 1.7x to 3.6x latency range is set by the baseline systems, not the chip, and the report's own publication date is unsettled. Read it as direction, not evidence.

Perspective Coverage

9 publishers
Builder
Builder 41%
Operator
Operator 31%
Investor
Investor 28%

Reality

Evidence52
Adoption14
Hype gap+38
Incentives82
Confidence68
leadershipOne report1 publisher

Investors quintupled Positron's valuation months before Asimov's tapeout

The $875 million round prices an inference chip whose performance figures come from cycle-accurate simulations and whose production date has moved from early 2027 into the second half. The system Positron ships today runs on HBM.

Publishers:implicator.ai

Reality

Evidence42
Adoption38
Hype gap+45
Incentives80
Confidence52
buildOne report1 publisher

Nvidia's Groq-derived LPX rack posts 3,431 tokens/sec on 128GB of SRAM

The first third-party benchmark of the LP30 rack came in at roughly four times the next-fastest public endpoint, measured one request at a time on a model small enough to fit.

Publishers:tomshardware.com

Reality

Evidence58
Adoption20
Hype gap+32
Incentives74
Confidence55
buildOne report1 publisher

Raptor's 0.37 pJ/bit is measured. The DRAM underneath it has no named fab.

d-Matrix says stacking compute on a co-designed DRAM die moves bits at roughly a sixth of HBM4's energy cost. It still has not said who fabricates the die.

Publishers:tomshardware.com

Reality

Evidence58
Adoption12
Hype gap+32
Incentives72
Confidence55
buildOne report1 publisher

Intel's Crescent Island bets 480GB of LPDDR5X and 350W beats paying for a liquid retrofit

Intel's Hot Chips disclosure details 32 Xe Cores, 32MB of L2 and 16-deep matrix engines. The figure it does not include is the one that decides whether the capacity is servable.

Publishers:tomshardware.com

Reality

Evidence58
Adoption
Not scored
Hype gap+30
Incentives68
Confidence52
investOne report1 publisher

Tiny corp wants Etched's numbers. Jane Street led $700M at $21B without publishing any

Etched has first-pass silicon, 400 staff and more than $1bn in booked orders. What it does not have in public is a peak FLOPS figure, a power draw, or a third-party benchmark.

Reality

Evidence27
Adoption41
Hype gap+52
Incentives79
Confidence34