The IP Behind NVIDIA's Inference Lead: A 2020 Grant on Sparse Convolution Hardware

Disclosure or it didn't happen — and the disclosure here is a granted patent, not a slide. Long before “AI data center” became the line item that moves NVIDIA's stock, the company was filing on the unglamorous hardware that determines whether running a model is cheap or ruinous. The grant US10528864B2 (“Sparse convolutional neural network accelerator,” issued 2020-01-07) is one of those records.

Strip the title to its mechanism: many of the weights inside a trained neural network are zero, and multiplying by zero wastes silicon and power. The patent, classified in CPC G06N 3/063 (neural-network hardware), covers an accelerator that detects and skips those zeros so the chip spends its energy only on the math that matters. The named inventors include William J. Dally, NVIDIA's chief scientist — a signal of how central this work was treated internally.

The business point is that inference cost is the denominator under every AI gross-margin claim. A chip that does more useful work per watt is the difference between a profitable inference service and a subsidised one. NVIDIA does not break out a “sparse accelerator” revenue line, and no filing claims it does; what the patent establishes is that the cost advantage the company would later monetize was being engineered years ahead of the demand.

Read against the disclosures that came later, the through-line is clear. NVIDIA's Data Center segment, which its Form 10-K reports as the dominant revenue source today, sits on top of an architecture whose efficiency tricks were patented when that segment was a fraction of its current size. The 2020 grant is the receipt for a bet the income statement only validated afterward.

The caveat the house rule requires: a patent is a claim of invention, not a claim of revenue. We are not asserting this specific grant generates a disclosed dollar figure — it doesn't, and the filings don't say so. We are saying the IP behind the inference cost structure is real, dated, and assignee-attributed, which is more than most narratives about NVIDIA's “moat” can show.