Edition 01 AI infrastructure, from first principles

Learn modern AI infrastructure

Deep technical courses on how inference systems, GPUs, the telemetry that watches them and the language they are built in actually work — and how to design and secure the AI systems built on top — from first principles to production.

Browse the courses Featured lessons

the map6 courses × 5 levels

Inference 36 27 40 34 34

GPU 4 5 10 8 4

Observability 4 9 5 7 4

Golang 5 6 11 5 9

System Design 3 6 6 7 3

Security 3 4 7 5 3

each cell = lessons at that level · click to jump in

The KV CacheContinuous BatchingPagedAttentionSMs, Warps and SIMTThe Roofline ModelMemory Planning for LLMsThe Garbage CollectorGoroutines and the SchedulerA Transformer Forward PassHistogramsInference Engine MetricsHow It Is ChangingAI Infrastructure for an Agentic PlatformThe 2026 LandscapeSandboxes and Tool ExecutionPrompt InjectionArchitectural DefensesSecuring an Agent PlatformThe KV CacheContinuous BatchingPagedAttentionSMs, Warps and SIMTThe Roofline ModelMemory Planning for LLMsThe Garbage CollectorGoroutines and the SchedulerA Transformer Forward PassHistogramsInference Engine MetricsHow It Is ChangingAI Infrastructure for an Agentic PlatformThe 2026 LandscapeSandboxes and Tool ExecutionPrompt InjectionArchitectural DefensesSecuring an Agent Platform

Courses

6 deep courses, organised by topic. Read one end to end, or jump straight to the lesson you need.

Inference Engineering

How modern LLM inference works — from a single matrix multiply to a multi-tenant serving platform.

14 topics186 lessons~354h 45m 02

GPU Engineering

The GPU itself — what is inside the chip, how it is programmed, why it is fast, and how thousands are run together.

7 topics32 lessons~27h 15m 03

Observability Engineering

Seeing inside running systems — metrics, logs, traces and profiles, then the GPU, token and cost telemetry that AI infrastructure adds.

6 topics30 lessons~24h 25m 04

Golang Engineering

Go from the first program to the runtime — how values sit in memory, how the allocator, garbage collector and scheduler work, and how to build AI systems in it.

6 topics37 lessons~33h 5m 05

AI System Design

Designing AI systems in 2026 — the building blocks, AI infrastructure from an empty rack to a platform, agentic systems, and full worked designs with the real tools named.

6 topics25 lessons~20h 35m 06

AI Security Engineering

Securing AI applications at every stage — data, models and supply chain, build, deployment, runtime and agents — with the attacks explained first and the defences that actually hold.

5 topics22 lessons~18h

New courses are added as plain Markdown folders. Distributed systems for AI and networking for GPU clusters are on the list.

Five levels, one order

Every course runs through the same five levels. Each level assumes the ones before it and nothing else.

01FoundationsBuild the mental model.
02BasicUnderstand the core mechanisms.
03IntermediateLearn the optimization techniques.
04AdvancedStudy systems at production scale.
05ExpertDesign platforms and read the frontier.

Start with fundamentals. No step assumes knowledge the course has not taught.
Understand the system. Mechanisms are built in small Go programs you can run.
Study the bottlenecks. Memory, bandwidth, queues — find what actually limits speed.
Learn the optimization techniques. Each one is derived from the bottleneck it removes.
Build real systems. Every course ends in projects, not quizzes.

Featured lessons

Inference Engineering The KV Cache Basic2h Inference Engineering Continuous Batching Basic2h Inference Engineering PagedAttention Basic2h GPU Engineering SMs, Warps and SIMT Basic1h GPU Engineering The Roofline Model Intermediate1h 10m GPU Engineering Memory Planning for LLMs Advanced1h 10m Golang Engineering The Garbage Collector Intermediate1h 10m Golang Engineering Goroutines and the Scheduler Intermediate1h Golang Engineering A Transformer Forward Pass Expert1h 30m Observability Engineering Histograms Basic55 min Observability Engineering Inference Engine Metrics Advanced1h 10m Observability Engineering How It Is Changing Expert1h AI System Design AI Infrastructure for an Agentic Platform Expert1h 30m AI System Design The 2026 Landscape Foundations45 min AI System Design Sandboxes and Tool Execution Advanced50 min AI Security Engineering Prompt Injection Basic50 min AI Security Engineering Architectural Defenses Advanced1h 5m AI Security Engineering Securing an Agent Platform Expert1h 20m