Playbook / AI system design

AI system design

AI/ML platform design — hellointerview depth

#Title
01Design an LLM inference serving platform at scaleStudy →
02Design a retrieval-augmented generation (RAG) platform at scaleStudy →
03Design an agent orchestration platform with real tool useStudy →
04Design a feature store / fine-tuning data pipelineStudy →
05Design a content moderation and safety system for generated contentStudy →
06Design a multimodal search / recommendation systemStudy →
07Design an LLM evaluation and observability platformStudy →
08Design a fine-tuning / RLHF training pipeline at scaleStudy →
09Design a multi-tenant AI platformStudy →
10Design a sandboxing architecture for AI agent code executionStudy →
11Design an on-device / edge AI inference architectureStudy →
12Design a training-data provenance and IP-risk architectureStudy →
13Design durable execution for long-running AI agentsStudy →
14Design a ChatGPT-style conversational serviceStudy →
15Design an AI coding assistant (Copilot-style)Study →
16Design an LLM-powered customer support assistantStudy →
17Design LLM application security against prompt injectionStudy →
18Design an AI data flywheel and human-feedback platformStudy →
19Design a model release, canary, and rollback platformStudy →
20Design persistent AI memory and personalizationStudy →
21Design a real-time voice AI assistantStudy →
22Design enterprise PDF Q&A with page citations and groundingStudy →
23Design enterprise hybrid retrieval with access-aware rankingStudy →
24Design identity and access management for AI agents and MCP toolsStudy →
25Design a real-time fraud and risk decisioning systemStudy →
26Design a multi-agent collaboration evaluation scorecardStudy →
27Design a real-time wait-time prediction service with an agent and interactive provenanceStudy →
28Design an enterprise LLM gateway (unified multi-provider platform)Study →
29Design a distributed GPU training job scheduler with preemption and checkpointingStudy →
30Design a unified query engine across dispersed data sources (email, calendar, docs, chat)Study →

30 of 30 · total playbook 138