Goblin Guide to AI Infrastructure
A field guide for humans · September 2026

The Goblin Guide to AI Infrastructure

Every chatbot answer is made by a very long chain of physical things: sand, light, memory, glue, drills, pipes, turbines. This guide follows one AI chip from sand to your screen, names the big players at each step, and explains how each one gets paid.

Nib saysHello. I am Nib, and I have dug through every layer of this mountain. The short version: goblins who sell shovels in a gold rush get paid once per goblin. Goblins who sell candles get paid every night the goblins dig. There are five kinds of goblin in this mountain, and knowing which one you are looking at explains most of what follows.

See it in AR: Nib's Mountain Hold up your phone: a life-size GPU rack in your room, a data-centre campus on your table, and one chip's journey from sand to your answer.
The scale of the thing

What happens when you ask a chatbot a question

Your question travels to a data centre and lands on a rack of AI chips. The flagship NVIDIA rack today, the GB200 or GB300 NVL72, holds 72 GPUs wired together so they behave like one giant chip. One rack draws roughly 120–140 kilowatts, about as much power as 100 American homes. It is cooled by liquid, not fans, and it is reported to cost around $3 million.

A large AI campus holds thousands of these racks and needs a gigawatt or more, the output of a nuclear reactor. By 2025–26, Microsoft, Amazon, Alphabet and Meta together were spending several hundred billion dollars a year building this. Every company in this guide is, one way or another, catching a share of that spending.

The sequence matters, so these are numbered

Follow one AI chip, from sand to your answer

  1. Sand becomes a wafer

    Ultra-pure silicon is grown into a crystal ingot and sliced into 300 mm discs called wafers.

    Shin-Etsu, SUMCO, GlobalWafers, Siltronic

  2. Circuits are printed on the wafer

    In a fab, the wafer goes through hundreds of steps over about three months: coating, printing patterns with light, etching, depositing thin films. The finest layers are printed with extreme-ultraviolet (EUV) light from machines that cost well over $150 million each and come from exactly one company. An AI GPU die is huge, so only a few dozen fit on one wafer.

    Foundry: TSMC (far ahead), Samsung, Intel · Tools: ASML (the only EUV maker), Applied Materials, Lam Research, Tokyo Electron, KLA (inspection)

  3. Memory is made separately and stacked

    AI chips starve without fast memory. HBM (high-bandwidth memory) stacks 8 to 16 thin DRAM chips on top of each other, connected by tiny vertical wires drilled through the silicon.

    SK hynix (the leader), Samsung, Micron · Stacking bonders: Hanmi, ASMPT, Hanwha

  4. The bare chips are tested

    Needles on a probe card touch each chip on the wafer to find the bad ones before anything expensive is attached. The industry calls this finding the "known good die".

    Probe cards: FormFactor, Technoprobe, MJC · Testers: Advantest, Teradyne

  5. Chips and memory are packaged together (CoWoS)

    The GPU dies and HBM stacks are placed side by side on a slab of silicon, then the whole thing is mounted on a package substrate. It has its own section below.

    TSMC (most of it), ASE/SPIL, Amkor · Tools: Shibaura, ASMPT, BESI, Towa, Disco · Substrates: Ibiden, Unimicron, with film from Ajinomoto

  6. The package is baked and stress-tested

    Burn-in runs each chip hot for hours so weak ones fail in the factory, not in the data centre. Then system-level test runs it like a real computer for hours more. Each chip sits in a custom socket during both.

    Sockets: Enplas, Yamaichi, WinWay, ISC · Test systems: Advantest, Teradyne, Aehr · Test houses: KYEC

  7. It goes onto a circuit board

    AI boards are thick slabs with 20 to 40 layers of copper and special low-loss laminate. They are riddled with tens of thousands of drilled holes, and the hard materials wear drill bits out fast.

    Boards: Victory Giant, Gold Circuit, TTM, WUS · Laminate: Elite Material · Drill bits: Dingtai, Union Tool, Topoint

  8. Boards become a rack

    Contract manufacturers assemble trays of GPUs, CPUs and switch chips into a finished rack with cold plates, pipes and power shelves.

    Foxconn (Hon Hai), Quanta Computer, Wistron/Wiwynn, Supermicro, Dell, HPE

  9. Racks are networked

    Thousands of racks must talk to each other at enormous speed. Inside a rack, copper; between racks, light carried by optical transceivers.

    Switch chips: NVIDIA, Broadcom · Switches: Arista, Cisco · Optics: Coherent, Lumentum, InnoLight, Eoptolink, Fabrinet · Cables and links: Amphenol, Credo, Astera Labs

  10. The data centre powers and cools it

    Transformers, switchgear, backup generators, batteries, chillers and cooling towers. Grid connections now take years, so some campuses build their own gas turbines or fuel cells.

    Power gear: Schneider, Eaton, Vertiv, ABB, Delta, Hitachi Energy · Cooling: Vertiv, Trane, Munters · Generation: GE Vernova, Siemens Energy, Mitsubishi Heavy, Bloom, Caterpillar

  11. Someone rents it and runs a model on it

    Cloud companies rent the chips to AI labs and businesses. The lab's model reads your question, predicts the answer one token at a time, and sends it back. That last step is paid per token or by subscription.

    Clouds: Microsoft Azure, AWS, Google Cloud, Oracle, CoreWeave, Nebius · Labs: OpenAI, Anthropic, Google DeepMind, Meta, xAI

The step that confused everyone

Inside the package: what CoWoS actually is

CoWoS stands for Chip-on-Wafer-on-Substrate, and the name describes the two assembly steps. First, the chips go on a wafer: GPU dies and HBM stacks are placed onto a thin slab of silicon, the interposer, which is cut from a wafer and carries millions of microscopic wires between them. Second, that assembly goes on a substrate: a sturdier package base that connects to the circuit board. The point is distance. Memory millimetres from the GPU can feed it data many times faster than memory elsewhere on the board.

GPU GPU lid and liquid cold plate sit on top 1 2 3 4 5 Side view of one AI chip package Not to scale. The real package is about the size of a coaster.
  1. 1Chip on wafer. GPU dies are placed onto the interposer and bonded through thousands of microscopic bumps. Bonders: Shibaura (TSMC's incumbent), ASMPT, K&S.
  2. 2HBM stacks sit beside the GPU, 8 to 16 memory chips tall. SK hynix, Samsung, Micron. Stacked with bonders from Hanmi, ASMPT, Hanwha.
  3. 3Interposer: the "wafer" in CoWoS. A silicon slab with dense wiring between GPU and memory. Made by TSMC.
  4. 4On substrate. The module is attached to the package substrate, which fans the connections out. Attach tools: ASMPT, BESI. Substrates: Ibiden, Unimicron, made with Ajinomoto build-up film.
  5. 5Server board. The package is soldered onto a thick, drilled circuit board. Drill bits: Dingtai, Union Tool, Topoint.
CoWoS-S and CoWoS-LS uses one big silicon interposer. L uses small silicon bridges inside a cheaper base, so it can be larger. NVIDIA's Blackwell and Rubin use L.
CoPoS (about 2028–29)The same idea on large square panels instead of round wafers, so more packages fit per batch. Tool makers compete again to supply it.
SoIC and hybrid bondingStacking chips directly on top of each other, copper to copper, with no bumps. Coming for future GPUs and memory. BESI and Applied Materials lead the tools.

Nib saysThis is why a bonder maker can disappoint even in a boom. It sells the machine for step 1. TSMC buys those machines when it adds new CoWoS capacity, then uses them for years. More GPUs made next year does not mean more bonders sold next year. It means more machines only if capacity keeps growing faster and faster.

Ten layers, the big players, and how each gets paid

The layers of the mountain

Each card names the largest listed companies with tickers, the chokepoint where one supplier holds most of the power, and which goblin it is, meaning how it gets paid (explained in the next section). The five goblins are shovel, blacksmith, blueprint, candle and toll-bridge.

The buyers: clouds and AI labs

toll-bridge
What
They buy the chips, build the data centres and rent out computing, or use it for their own models and products.
AI changed
Capex budgets several times their pre-2023 level. Their spending decisions set demand for everything below.
Players
Microsoft, Amazon, Alphabet, Meta, Oracle, CoreWeave, Nebius. Labs: OpenAI, Anthropic, xAI (private) and Google DeepMind.
Chokepoint
Power and chips. They compete for both.

Chip designers

blacksmith
What
Design the GPUs and custom AI chips, then pay a foundry to make them.
AI changed
GPUs went from gaming parts to the centre of computing. Big clouds now design their own chips as well, with partners.
Players
NVIDIA (commonly estimated at 80%+ of AI accelerators), AMD, Broadcom (Google TPU, Meta chips), Marvell, Arm (CPU designs). In-house: Google TPU, AWS Trainium, Microsoft Maia, Meta MTIA.
Chokepoint
NVIDIA's software ecosystem (CUDA) and its rack-scale designs.

Foundries and chipmaking tools

shovel
What
Fabs print the circuits; toolmakers sell them the machines; design-software firms sell the tools engineers draw chips with.
AI changed
Demand for the most advanced nodes and the largest dies. Foundry revenue is per chip; tool revenue is build-out.
Players
TSMC, Samsung, Intel. Tools: ASML, Applied Materials, Lam Research, Tokyo Electron, KLA. Design software: Synopsys, Cadence.
Chokepoint
TSMC makes nearly all leading AI chips. ASML is the only EUV lithography supplier.

Memory (HBM)

blacksmith
What
Stacks of DRAM that sit beside each GPU and feed it data.
AI changed
Each GPU generation carries more HBM. HBM uses about three times the wafer area per bit of normal DRAM, which tightens the whole memory market.
Players
SK hynix (the leader), Samsung, Micron.
Chokepoint
Only three makers. Memory is famously cyclical.

Advanced packaging and test

shovelblueprint
What
Assembling chips and memory into one package (CoWoS), then testing and burning it in.
AI changed
Packaging went from a cheap final step to a bottleneck. CoWoS capacity roughly doubled in 2025 and is reported to double again by 2028.
Players
TSMC, ASE, Amkor. Substrates: Ibiden, Unimicron, film from Ajinomoto. Tools: BESI, ASMPT, Disco, Shibaura, Towa. Test: Advantest, Teradyne, FormFactor; sockets Enplas, WinWay.
Chokepoint
TSMC's CoWoS lines; Ajinomoto's near-monopoly film.

Boards, servers and racks

blacksmithcandle
What
Circuit boards, trays and finished racks, built by contract manufacturers to NVIDIA or cloud designs.
AI changed
Boards got thicker and harder to make; racks became one 72-GPU machine. Assemblers see huge revenue on thin margins; drill bits and special laminates see real pricing.
Players
Foxconn, Quanta Computer, Wiwynn, Supermicro, Dell, HPE. Boards: Victory Giant, Gold Circuit, TTM. Laminate: Elite Material. Drills: Dingtai, Union Tool, Topoint.
Chokepoint
Low-loss laminate materials and high-end drill capacity.

Networking and optics

blacksmith
What
Switch chips, switches, cables and optical transceivers that tie thousands of GPUs into one cluster.
AI changed
Training needs every GPU talking to every other at once. Optics are the next bottleneck, and co-packaged optics (lasers right on the chip package) are arriving.
Players
NVIDIA (NVLink, InfiniBand, Spectrum-X), Broadcom, Arista, Cisco, Marvell, Credo, Astera Labs, Amphenol. Optics: Coherent, Lumentum, InnoLight, Eoptolink, Fabrinet.
Chokepoint
Laser chips made from indium phosphide, and NVIDIA's own interconnect.

Power and cooling inside the building

shovel
What
Transformers, switchgear, backup power, batteries, liquid-cooling loops, chillers and cooling towers.
AI changed
Racks jumped from 10 kW to 120+ kW, heading for 1 MW. Air cooling stops working around 40–50 kW, so liquid became mandatory. Power is moving toward 800-volt DC.
Players
Schneider, Eaton, Vertiv, ABB, Delta, nVent. Cooling: Trane, Johnson Controls, Munters. Backup: Caterpillar, Cummins, Generac.
Chokepoint
Transformers and chillers with long lead times.

Energy and the grid

shoveltoll-bridge
What
Making the electricity and moving it to the campus.
AI changed
Single campuses now want a gigawatt. Grid connections take years, so gas turbines, fuel cells and nuclear deals came back into fashion. Turbines are sold out for years.
Players
GE Vernova, Siemens Energy, Mitsubishi Heavy, Hitachi, Bloom Energy. Power sellers: Constellation, Vistra. Transformer makers: HD Hyundai Electric, Hyosung Heavy.
Chokepoint
Turbine slots, transformers and interconnection queues.

Data-centre landlords and builders

shoveltoll-bridge
What
Companies that own buildings and lease space and power, and the contractors who build them.
AI changed
Leases are now sold by the megawatt. Electricians and mechanical contractors became AI stocks.
Players
Equinix, Digital Realty. Builders: Quanta Services (not the same company as Quanta Computer), EMCOR, Comfort Systems.
Chokepoint
Sites with power already connected.
How the money flows

The five goblins: how each one gets paid

Every company in the stack is paid in one of five ways. The dotted line in each sketch is AI activity, which grows fast and then levels off. The coloured line is what happens to that goblin's revenue. The AI boom is the same in every sketch, and the outcomes are very different. This is why CoWoS volume can keep growing while a bonder maker's revenue does not.

shovel

The shovel goblin is paid when capacity is added. Revenue follows the speed of building, so it rises and then falls even while activity stays high.

Bonders, lithography tools, transformers, construction

blacksmith

The blacksmith goblin is paid for every item forged. Revenue follows production, with swings when chip generations change. It is the biggest goblin by money.

NVIDIA, TSMC, HBM makers, contract manufacturers

blueprint

The blueprint goblin is paid for each new chip design. Custom parts are thrown away when the design changes, not when they wear out. Revenue dips if volumes flatten.

Burn-in sockets, probe cards, photomasks

candle

The candle goblin is paid as the product burns down. Consumption follows the level of activity, and harder materials push it higher. The risk moves to competition and price.

Drill bits, polishing pads and slurries, test contacts

toll-bridge

The toll-bridge goblin is paid every time someone crosses. Rent, subscriptions, tokens, royalties, electricity bills, service contracts.

Clouds, AI labs, power sellers, landlords, maintenance

Nib saysA candle that everyone can make becomes cheap. A bridge with no other way across becomes a toll road. And even the best bridge is a bad investment if you paid too much for it.

The shovel, blueprint, candle and toll-bridge names came from a conversation with ChatGPT. The blacksmith was added here.

Search it

The goblin dictionary