LLM 推理与大规模部署 Certification
以低成本、高速度、高可靠性在规模上服务大型语言模型
Key facts
- Level: Professional
- Field: Artificial Intelligence & LLMs
- Estimated study time: about 38 hours
- Credential price: $149
- Exam: 75 questions · 105 minutes · pass mark 75%
About the LLM 推理与大规模部署 certification
将训练好的模型转变为一项在真实流量下快速、经济且可靠的生产服务。本专业认证涵盖推理与训练在本质上的区别、自回归解码循环，以及主导成本的两个阶段：计算密集型的预填充（Prefill）与内存密集型的解码（Decode）。你将深入掌握KV缓存——它为何存在、在GPU显存中的开销，以及为何它（而非模型权重）往往才是限制吞吐量的瓶颈——以及分摊该成本的各种批处理策略：静态批处理、动态批处理与连续（在途）批处理。 核心服务工具链随后展开：用于高效KV显存管理的PagedAttention与vLLM、用于IO感知注意力计算的FlashAttention、量化（int8/int4、GPTQ、AWQ、GGUF，以及纯权重量化与权重+激活量化）及其精度权衡、用于降低延迟的推测/辅助解码，以及用于单GPU无法容纳的大模型的张量并行。你将进行GPU显存数学计算（参数、KV缓存、激活值），分析真正重要的延迟指标——TTFT、TPOT/ITL与端到端延迟——并在吞吐量与延迟之间做出合理权衡。 最后你将学习如何运营该服务：自动扩缩容与负载均衡、选择服务栈（vLLM / TGI / TensorRT-LLM）、提示词与前缀缓存、成本优化、监控与可观测性，以及服务端护栏。学完后，你将能够规划、部署、调优并为真实的LLM推理部署方案进行辩护。
What you will learn
The official LLM 推理与大规模部署 study course covers:
- From Training to Inference — Why serving is a different problem: the forward-only decode loop, the prefill/decode split, and the KV-cache that defines LLM inference.
- The KV-Cache & GPU-Memory Math — Why the KV-cache exists, what it costs, and how to size weights + KV + activations for a real deployment.
- Batching & Attention Kernels — Static, dynamic, and continuous batching; PagedAttention's paged KV; and FlashAttention's IO-aware exact attention.
- Quantization & Faster Decoding — Int8/int4 weight and activation quantization (GPTQ, AWQ, GGUF), the accuracy tradeoff, and speculative decoding.
- Serving at Scale — Latency metrics, throughput/latency tradeoffs, tensor parallelism, serving stacks, caching, autoscaling, cost, observability, and guardrails.
Prerequisites
Frequently asked questions
- Is the LLM 推理与大规模部署 certificate verifiable?
- Yes. Every issued Hootix Academy certificate carries a unique credential code that anyone can verify online.
- How is the LLM 推理与大规模部署 exam structured?
- It is a 105-minute proctored multiple-choice exam of 75 questions; you need 75% to pass.
- Do I need to buy the course to take the exam?
- You can purchase the certification exam on its own, or bundle it with the full study course at a reduced price.
- How long does the LLM 推理与大规模部署 course take?
- About 38 hours of self-paced study.