Knowledge Graph

109 lessons across 12 phases, linked by 97 prerequisite, 131 builds-on, and 29 related edges. Hover a lesson to trace its dependency path; click to pin it and read what it needs, what it unlocks, and the evidence for each link. Turn on Mastery to shade the map with what you already know, or Recall to cover the titles and test yourself.

prerequisite
order only
builds-on
related
depends on
unlocks
Hover to preview a lesson, click to pin it and read what it depends on. Drag to pan · ⌘/Ctrl+scroll to zoom · Esc to clear.
🧠Phase 1Foundations & Model Inference📐System Design Foundations💬Phase 2Prompting & Structured Output🔍Phase 3Embeddings & RAG🤖Phase 4Agents & Orchestration🧠Phase 5Long-Term MemoryPhase 6LangChain & LangGraph🛡Phase 7Evals, Safety & Observability🚀Phase 8Ship to Production🔧AppendixFine-tuning & TrainingAppendixOther Clouds & Platforms🏗AppendixEngineering & Communication2The AI Engineer'sRoadmap: Skills, Tools &…The AI Engineer's Roadmap: Skills, Tools & Career Path4TransformerArchitecture: Attention,…Transformer Architecture: Attention, Positional Encoding & Scale5Tokenization: BPE,SentencePiece &…Tokenization: BPE, SentencePiece & Vocabulary Design6LLM ArchitecturesCompared: GPT, Claude,…LLM Architectures Compared: GPT, Claude, Llama, Gemini, Mistral, and Beyond7Scaling Laws:Chinchilla, Emergent…Scaling Laws: Chinchilla, Emergent Abilities & Compute-Optimal Training8Inference Optimization:KV Cache, Quantization &…Inference Optimization: KV Cache, Quantization & Speculative Decoding9Pre-training: DataCuration, Objectives &…Pre-training: Data Curation, Objectives & Curriculum72Scaling & LoadBalancing: GPU Clusters,…Scaling & Load Balancing: GPU Clusters, Model Parallelism & Routing74Production AI Patterns:Workflows, Pipelines &…Production AI Patterns: Workflows, Pipelines & Architecture90MicroservicesMicroservices93SOLID PrinciplesSOLID Principles94ACID PropertiesACID Properties95PostgreSQL JOINs: Inner,Outer, Cross, Self,…PostgreSQL JOINs: Inner, Outer, Cross, Self, Lateral & Performance96Foreign Keys:Referential Integrity,…Foreign Keys: Referential Integrity, Cascades & Migration Patterns10Prompt EngineeringFundamentals: Principles…Prompt Engineering Fundamentals: Principles & Patterns11Few-Shot &Chain-of-Thought…Few-Shot & Chain-of-Thought Prompting12System Prompt Design:Instructions, Personas &…System Prompt Design: Instructions, Personas & Guardrails13Structured Output: JSONMode, Tool Schemas &…Structured Output: JSON Mode, Tool Schemas & Constrained Decoding14Function Calling & ToolIntegration: APIs,…Function Calling & Tool Integration: APIs, Schemas & Execution15Tool Use: FunctionCalling as an Agentic…Tool Use: Function Calling as an Agentic Pattern16Prompt Optimization:DSPy, Automatic Prompt…Prompt Optimization: DSPy, Automatic Prompt Engineering & Meta-Prompting17Prompt Caching: KV CacheMechanics, Prefix…Prompt Caching: KV Cache Mechanics, Prefix Caching & Cost Optimization18Adversarial Prompting:Jailbreaks, Injections &…Adversarial Prompting: Jailbreaks, Injections & Defense Strategies99Spec-Driven Development:Specs as the Durable…Spec-Driven Development: Specs as the Durable Contract for Coding Agents20EmbeddingsEmbeddings21Embedding Models:Representations,…Embedding Models: Representations, Similarity & Fine-tuning22Vector Databases:Indexing, ANN Search &…Vector Databases: Indexing, ANN Search & Production Patterns23LanceDB: EmbeddedMultimodal Vector…LanceDB: Embedded Multimodal Vector Lakehouse24Chunking Strategies:Splitting, Overlap &…Chunking Strategies: Splitting, Overlap & Semantic Boundaries25Retrieval Strategies:Hybrid Search, Reranking…Retrieval Strategies: Hybrid Search, Reranking & HyDE26RAG: Retrieval-AugmentedGeneration as an Agentic…RAG: Retrieval-Augmented Generation as an Agentic Pattern27Advanced RAG: Agentic,Graph-Based & Multi-Hop…Advanced RAG: Agentic, Graph-Based & Multi-Hop Retrieval28RAG Evaluation:Faithfulness, Relevance…RAG Evaluation: Faithfulness, Relevance & Failure Modes29Agent Architectures:ReAct, Plan-and-Execute…Agent Architectures: ReAct, Plan-and-Execute & Cognitive Frameworks30Multi-Agent Systems:Orchestration,…Multi-Agent Systems: Orchestration, Delegation & Communication32Agent Orchestration:Routing, Handoffs &…Agent Orchestration: Routing, Handoffs & Supervisor Patterns33Agent Harnesses: EventLoops, Permission Models…Agent Harnesses: Event Loops, Permission Models & Tool Sandboxing34Agent SDKs: Claude,OpenAI, Vercel AI SDK &…Agent SDKs: Claude, OpenAI, Vercel AI SDK & Framework Comparison35Code Generation Agents:Sandboxing, Iteration &…Code Generation Agents: Sandboxing, Iteration & Self-Repair36Agent Debugging &Observability: Tracing,…Agent Debugging & Observability: Tracing, Replay & Root Cause Analysis100ReAct Agents Lab:Building the…ReAct Agents Lab: Building the Reason-Act-Observe Loop101Reflexion:Self-Improving Agents…Reflexion: Self-Improving Agents via Verbal Reinforcement102Plan-and-Execute Agents:Decompose First, Then…Plan-and-Execute Agents: Decompose First, Then Act103LATS: Tree Search Agentswith Monte-Carlo Tree…LATS: Tree Search Agents with Monte-Carlo Tree Search104Supervisor Multi-AgentLab: Routing Work Across…Supervisor Multi-Agent Lab: Routing Work Across Specialist Workers105Tree of Thoughts:Deliberate Search Over…Tree of Thoughts: Deliberate Search Over Reasoning Steps106Self-Refine: IterativeRefinement with…Self-Refine: Iterative Refinement with Self-Feedback107ReWOO and LLMCompiler:Efficient Tool PlanningReWOO and LLMCompiler: Efficient Tool Planning108Multi-Agent Debate:Convergence Through…Multi-Agent Debate: Convergence Through Critique109Generative Agents: TheMemory StreamGenerative Agents: The Memory Stream110Agent Persistence &Human-in-the-Loop:…Agent Persistence & Human-in-the-Loop: Making Agents Shippable111Benchmarking Agents:Suites, Trajectory…Benchmarking Agents: Suites, Trajectory Metrics, and a Regression Gate31Agent Memory:Short-term, Long-term &…Agent Memory: Short-term, Long-term & Episodic Memory Systems37Memory: Persistence asan Agentic PatternMemory: Persistence as an Agentic Pattern38Context Engineering:Designing What LLMs SeeContext Engineering: Designing What LLMs See39Context WindowManagement: Token…Context Window Management: Token Budgets, Prioritization & Overflow Strategies40Memory Architectures forLLM Systems: Working,…Memory Architectures for LLM Systems: Working, Episodic & Semantic Memory41Dynamic ContextAssembly: Runtime…Dynamic Context Assembly: Runtime Composition for LLM Applications42Context Compression:Fitting More Signal into…Context Compression: Fitting More Signal into Fewer Tokens49Long-Term Agent Memorywith LangMem &…Long-Term Agent Memory with LangMem & Cloudflare Vectorize43LangChain Fundamentals:Runnables, LCEL &…LangChain Fundamentals: Runnables, LCEL & Composable Chains on the Edge44LangChain Tools &Retrievers: Grounding…LangChain Tools & Retrievers: Grounding Chains in Your Own Data45LangGraph: StatefulMulti-Agent Graphs for…LangGraph: Stateful Multi-Agent Graphs for Production AI46LangGraphHuman-in-the-Loop:…LangGraph Human-in-the-Loop: Interrupts, Approval Gates & Time Travel47LangGraph Multi-AgentTopologies: Supervisor,…LangGraph Multi-Agent Topologies: Supervisor, Swarm & Hierarchical Teams48LangGraph Checkpointingon Cloudflare D1:…LangGraph Checkpointing on Cloudflare D1: Durable State & Resumable Graphs50Streaming &Observability for…Streaming & Observability for LangGraph: SSE, Stream Modes & LangSmith Tracing51Deploying LangGraph inProduction: Platform,…Deploying LangGraph in Production: Platform, Self-Host & the Cloudflare Edge52Red-Teaming LLMApplications with…Red-Teaming LLM Applications with LangGraph: Graph-Based Adversarial Pipelines53LLM EvaluationFundamentals: Metrics,…LLM Evaluation Fundamentals: Metrics, Datasets & Methodology54Benchmark Design:Contamination,…Benchmark Design: Contamination, Saturation & Domain-Specific Evals55LLM-as-Judge: AutomatedEvaluation, Calibration…LLM-as-Judge: Automated Evaluation, Calibration & Bias56Human Evaluation:Annotation Design,…Human Evaluation: Annotation Design, Inter-Rater Reliability & Scale57Eval FrameworksComparison: DeepEval,…Eval Frameworks Comparison: DeepEval, Promptfoo, RAGAS, Braintrust, LangSmith & More58DeepEval Synthesizer:Synthetic Golden…DeepEval Synthesizer: Synthetic Golden Generation for LLM Evaluation59Agent Evaluation:Reliability, Tool Use…Agent Evaluation: Reliability, Tool Use Accuracy & Trajectory Analysis60Red Teaming &Adversarial Testing:…Red Teaming & Adversarial Testing: Automated & Manual Approaches61Guardrails & ContentFiltering: Input/Output…Guardrails & Content Filtering: Input/Output Safety Layers62Hallucination Detection& Mitigation: Grounding…Hallucination Detection & Mitigation: Grounding & Verification63Constitutional AI & RLHFfor SafetyConstitutional AI & RLHF for Safety64Bias, Fairness &Responsible AI in…Bias, Fairness & Responsible AI in Production65AI Governance:Compliance, Auditing &…AI Governance: Compliance, Auditing & Risk Management66Interpretability &Explainability:…Interpretability & Explainability: Mechanistic & Feature-Level Analysis67Observability: Tracing,Logging & LLM MonitoringObservability: Tracing, Logging & LLM Monitoring68Online Evaluation:Production Sampling,…Online Evaluation: Production Sampling, Drift Detection & Feedback Loops69AI Gateways: RateLimiting, Fallbacks &…AI Gateways: Rate Limiting, Fallbacks & Multi-Provider Routing70Edge Deployment:On-Device Models, ONNX &…Edge Deployment: On-Device Models, ONNX & WebLLM71Cost Optimization: TokenEconomics, Caching &…Cost Optimization: Token Economics, Caching & Model Selection73LLM Serving: API Design,Batching & StreamingLLM Serving: API Design, Batching & Streaming75CI/CD for AI: RegressionTesting, Monitoring &…CI/CD for AI: Regression Testing, Monitoring & Continuous Eval76Search & Recommendationswith LLMsSearch & Recommendations with LLMs77Conversational AI:Chatbot Design, Dialogue…Conversational AI: Chatbot Design, Dialogue Management & UX78Vision-Language Models:Architecture, Training &…Vision-Language Models: Architecture, Training & Applications79Audio & Speech AI: ASR,TTS & Voice AgentsAudio & Speech AI: ASR, TTS & Voice Agents80AI for Code: Copilots,Code Review & Program…AI for Code: Copilots, Code Review & Program Synthesis81Fine-tuningFundamentals: Full,…Fine-tuning Fundamentals: Full, Freeze & Transfer Learning82LoRA, QLoRA & AdapterMethods:…LoRA, QLoRA & Adapter Methods: Parameter-Efficient Fine-tuning83RLHF & PreferenceOptimization: DPO, ORPO…RLHF & Preference Optimization: DPO, ORPO & PPO84Dataset Curation:Synthetic Data, Quality…Dataset Curation: Synthetic Data, Quality Filtering & Annotation85Continual Learning:Catastrophic Forgetting…Continual Learning: Catastrophic Forgetting & Knowledge Retention86Distillation & ModelCompression: Pruning,…Distillation & Model Compression: Pruning, Quantization & Student Models87Google Cloud PlatformGoogle Cloud Platform88DockerDocker89KubernetesKubernetes91CI/CDCI/CD92Node.jsNode.js97LlamaIndexLlamaIndex98Public Speaking:Structure, Delivery, and…Public Speaking: Structure, Delivery, and Audience Engagement112Landing an AIEngineering Role:…Landing an AI Engineering Role: Interviews, Negotiation & the Search