Skip to content

Nvidia H100

Nvidia's H100 (GH100) is a data-center GPU built on the Hopper architecture, used widely for training and running large AI models.

Known aliases

  • GH100
  • H100
  • H100 80GB
  • H100 80GB SXM
  • H100 equivalents
  • H100 SXM
  • H100 SXM5
  • Nvidia H100

Current stories

investOne report1 publisher

Heat limits Google's four orbiting TPUs to 15-minute runs

Google's Project Suncatcher put a satellite carrying four TPU chips into orbit on Oct. 1 to test AI computing in space. NPR reported the chips run only 15 minutes before cooling down, and that limit decides how much computing each launched kilogram can deliver.

Publishers:fortune.com

Reality

Evidence45
Adoption10
Hype gap+40
Incentives60
Confidence50
investConfirmed20 publishers

DOJ's $300 million GPU case casts a California reseller's suppliers as the deceived party

Federal prosecutors charged EarthMade Computer owner Greg Lui with smuggling more than $300 million in GPU servers to China through Malaysia and Singapore. So far the case charges only Lui and treats the US manufacturers that sold him servers as parties he deceived with false end-user papers.

Perspective Coverage

21 publishers
Builder
Builder 19%
Operator
Operator 52%
Investor
Investor 29%

Reality

Evidence74
Adoption
Not scored
Hype gap+22
Incentives58
Confidence70
investOne report1 publisher

Washington think tank counts 343 immersion DUV machines in Chinese-owned fabs

Chinese-owned chip plants held 343 immersion DUV machines by early this year, about 270 of them ASML NXT:1980i units, a Washington think tank says. Its authors want all new DUV shipments stopped, and a bipartisan bill in Congress would require the Netherlands and Japan to do exactly that.

Publishers:en.sedaily.com

Reality

Evidence35
Adoption55
Hype gap+25
Incentives70
Confidence40
investOne report1 publisher

CME's 36-month GPU futures put a forward price on the compute bitcoin miners now sell

CME plans to list two Nvidia GPU compute futures on October 5, pending regulatory approval, with prices running 36 months forward. Bitcoin miners that moved into AI hosting can hedge with them only if what they are paid moves with a GPU rental index.

Reality

Evidence42
Adoption10
Hype gap+55
Incentives78
Confidence45
investOne report1 publisher

Thieves who stole PlusAI's Nvidia-branded trailer found 20,000 pounds of test sand

Thieves broke into two PlusAI trailers taken from Fremont, one Nvidia-branded, and found 40,000 pounds of test sand. Overhaul's tally of more than $150 million in AI cargo losses is small next to AI spending, but single thefts run into the millions, and that cost lands on whoever ships each load of chips.

Publishers:fortune.com

Reality

Evidence45
Adoption
Not scored
Hype gap+35
Incentives65
Confidence45
buildOne report1 publisher

Four of five Qwen 3.8 27B engines finish within about 10% at 64 streams in g factor's tests

g factor's Qwen 3.8 27B benchmark has Together AI fastest at one stream, at 189.61 tok/s, while four of five engines finish within about 10% at 64 streams. Choosing a provider from these numbers starts with knowing how many streams the deployment will run at once.

Publishers:dev.to

Reality

Evidence48
Adoption
Not scored
Hype gap+18
Incentives72
Confidence45
buildOne report1 publisher

LessWrong cost study prices the median hour of AI task work at 4 cents of GPU time

LessWrong post puts the GPU cost of an AI doing an hour of median human work at about 4 cents, against a $25 US median wage. Current API prices narrow that gap sharply, and for the hardest tasks they lift AI cost to the hourly rate of a skilled engineer.

Publishers:lesswrong.com

Reality

Evidence30
Adoption
Not scored
Hype gap+35
Incentives
Not scored
Confidence35
buildOne report1 publisher

FastGPU finds hyperscalers charging three times the market floor for H100 and B200 hours

FastGPU's September 27 snapshot of 28 GPU clouds puts the cheapest hyperscaler H100 at $5.38 an hour, 3.0x the $1.79 market floor. That premium buys IAM, managed services and credits, and it is worth paying when a team actually uses them.

Publishers:dev.to

Reality

Evidence45
Adoption
Not scored
Hype gap+15
Incentives65
Confidence50
productConfirmed5 publishers

Starcloud raises $250M at $2.3bn because rockets, not GPUs, are the scarce input

The orbital compute startup added an extension to its Series A largely to buy launch capacity before Falcon 9 retires in 2028, according to CEO Philip Johnston.

Perspective Coverage

5 publishers
Builder
Builder 34%
Operator
Operator 26%
Investor
Investor 40%

Reality

Evidence55
Adoption15
Hype gap+45
Incentives70
Confidence60
buildOne report1 publisher

Booting a real server flips 147 of 627 agent patches from pass to fail

NVIDIA's SWE-Serve scores the same 627 patches twice on 19 SGLang tasks, once with the live-serving tests and once without. The pass rate falls from 69.4% to 45.9%, and 242 of the 276 live tests came from SGLang itself.

Reality

Evidence58
Adoption30
Hype gap−10
Incentives70
Confidence60
buildOne report1 publisher

Kaitchup traces Bonsai 2's 98.2% retention figure to unpacked weights on an H100

Ternary weights at 1.76 bits put a 27B model into a 5.9GB file and let a laptop decode it at 28.1 tokens a second. The retention figure comes from Prism ML's own benchmark suite, not the table on the model card.

Publishers:dev.to

Reality

Evidence38
Adoption42
Hype gap+34
Incentives74
Confidence46
buildOne report1 publisher

vLLM measured its portability layer at 3.4 percent below native throughput on an H100

PyTorch says vLLM's frontier models now ship as hardware-specific flat definitions that torch.compile cannot trace, and the new HW agnostic layers are what users on other accelerators get instead. The overhead figure came from an H100.

Publishers:pytorch.org

Reality

Evidence55
Adoption45
Hype gap+10
Incentives60
Confidence55
buildOne report1 publisher

Two thresholds at 0.25 decide which of Grounding-Dino's 900 default boxes survive

The Replicate build from hautechai takes one image URI and one query string per call, with both thresholds adjustable between 0 and 1. Throughput and memory are numbers you would have to measure yourself.

Publishers:dev.to

Reality

Evidence55
Adoption
Not scored
Hype gap−10
Incentives40
Confidence55
buildOne report1 publisher

Paging the KV cache into 16-token blocks caps the waste at 960 KB per sequence

One 8,192-token session on a 27B model holds 512 MB of key-value cache, or 64 KB for every token generated. How many of those sessions fit in free VRAM sets serving concurrency, and paging decides the waste.

Publishers:dev.to

Reality

Evidence58
Adoption
Not scored
Hype gap+24
Incentives45
Confidence48
scienceOne report1 publisher

Three previews of a MacBook-sized Jev rebuild miss the release screen their author declared

kev packs a document and every typed question into one sequence and reads them in a single forward pass on a Mac. Its author scored four checkpoints against the real Jev on frozen items and published the reads that missed a pre-declared gate.

Publishers:scour.ing

Reality

Evidence48
Adoption12
Hype gap−8
Incentives55
Confidence45
scienceOne report1 publisher

NVIDIA's Nemotron 3 Super routes each token through a tenth of its 120 billion parameters

NVIDIA says multi-agent systems burn up to 15 times the tokens of a standard chat, and Nemotron 3 Super is its open-weight attempt to make each of those tokens cheaper to produce. The efficiency figures come with NVIDIA's own hardware and its own predecessor as the baselines.

Reality

Evidence38
Adoption18
Hype gap+34
Incentives88
Confidence57
buildOne report1 publisher

Pointing the Ray head and workers at vLLM's own image removes the numpy 2.0 ABI crash

A dev.to walkthrough of a 600GB NVFP4 model on discounted 8xH100 spot nodes traces the two crashes that arrive before the first prompt to a pip resolver replacing numpy and a KV cache sized for a million tokens.

Publishers:dev.to

Reality

Evidence26
Adoption14
Hype gap+34
Incentives
Not scored
Confidence28
buildOne report1 publisher

C4ADS traces $4.6bn of Nvidia hardware to one Southeast Asian importer with unresolved ownership

A C4ADS investigation maps three routes for restricted accelerators into China, and almost all of the value it counted sits with a single importer whose ownership is still unresolved.

Publishers:tomshardware.com

Reality

Evidence52
Adoption45
Hype gap+28
Incentives62
Confidence50
investOne report1 publisher

Private credit's $200bn AI book rests on utilization the borrower has no standard way to prove

An American Banker opinion piece argues that GPU-backed loans audit serial numbers and liens while the compute that repays them goes unmetered, and it points at power finance, where lenders advance against settled megawatt hours.

Reality

Evidence36
Adoption18
Hype gap+33
Incentives74
Confidence38

Earlier coverage

  1. Robot makers buy the inference before they sell the robot

    Invest · September 15, 2026 · One report1 publisher

  2. Starcloud's $250M is a down payment on rockets it cannot yet buy

    Build · August 21, 2026 · Confirmed2 publishers